Multi display device and method of photographing thereof

ABSTRACT

A multi display device and a method of photographing thereof. The multi display device includes a first body having a first display unit, a second body having a second display unit, a hinge unit disposed to connect the first and second bodies to each other, a first imaging unit provided in the first body, a second imaging unit provided in the second body, and a controller which, if photographing is performed by the first or second imaging unit when the first or second body pivots based on the hinge unit, combines a plurality of photographed images to generate a panorama image content.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority under 35 U.S.C. §119 from Korean PatentApplication No. 10-2012-0112683, filed on Oct. 10, 2012, in the KoreanIntellectual Property Office, the disclosure of which is incorporatedherein by reference in its entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present general inventive concept generally relates to providing amulti display device and a method of photographing thereof, and moreparticularly, to providing a multi display device which captures one ormore subjects by using a plurality of imaging units and captured imagesof the subjects, and a method of photographing thereof.

2. Description of the Related Art

Various types of display devices have been used with the development oftechnologies. Such a display device includes a camera. In general, thecamera installed in the display device provides basic functions ofcapturing subjects and moving pictures.

As a performance of hardware of a portable display device is improved,and a display unit displays a high-quality, clear image, variousfunctions using a camera have been developed. A camera installed in adisplay device having a communication function includes a generalphotographing function and a function of capturing and transmitting animage to a user when performing a video conference.

However, a conventional camera using technology mainly premises adisplay device including one display unit. Therefore, researches on acamera using technology appropriate for a multi display device includinga plurality of display units have been unsatisfied. In particular, if aplurality of cameras are installed, researches on a method ofeffectively using the cameras have also been unsatisfied.

Accordingly, there is required a technology by which a user variouslyuses a plurality of cameras in a multi display device including theplurality of cameras and a plurality of display units

SUMMARY OF THE INVENTION

The exemplary embodiments provide a multi display device which capturesvarious images by using a plurality of imaging units, and a method ofphotographing thereof.

Additional features and utilities of the present general inventiveconcept will be set forth in part in the description which follows and,in part, will be obvious from the description, or may be learned bypractice of the general inventive concept.

The foregoing and/or other features and utilities of the present generalinventive concept may be achieved by providing a multi display deviceincluding a first body which includes a first display unit, a secondbody which includes a second display unit, a hinge unit which connectsthe first and second bodies to each other, a first imaging unit which isprovided in the first body, a second imaging unit which is provided inthe second body, and a controller which, if photographing is performedby the first or second imaging unit when the first or second body pivotsbased on the hinge unit, combines a plurality of photographed images togenerate a panorama image content.

If the first body pivots in a first direction based on the hinge unit,the controller may control the second display unit to display a liveview generated by the first imaging unit and perform photographing byusing the first imaging unit to capture images within a firstphotographing range, and combine all of the images captured within thefirst photographing range to one another to generate a panorama imagecontent.

If the first body pivots in a first direction based on the hinge unit,the controller may control the second display unit to display a liveview generated by the first imaging unit and perform photographing byusing the first imaging unit to capture images within a firstphotographing range. If the second body pivots in a second directionopposite to the first direction based on the hinge unit, the controllermay control the first display unit to display a live view generated bythe second imaging unit and perform photographing by using the secondimaging unit to capture images within a second photographing range. Thecontroller may combine all of the images captured within the firstphotographing range and the images captured with in the secondphotographing range to one another to generate a panorama image content.

If a particular portion of a subject is recognized in the live view, thecontroller may perform automatic photographing.

If an interval angle between the first and second bodies meets a presetcondition, the controller may perform automatic photographing.

If the pivoting starts, the controller may perform automaticphotographing every preset time period.

The controller may control at least one of the first and second displayunits to display a photographing range setting screen if a panoramaphotographing mode starts and automatically adjust photographing anglesof the first and second imaging units according to a set photographingrange if the photographing range is set on the photographing rangesetting screen.

The controller may control at least one of the first and second displayunits to display a photographing range setting screen if a panoramaphotographing mode starts and display a guide image on the first andsecond display units, wherein the guide image induces photographingangles of the first and second imaging units to be adjusted according toa set photographing range if the photographing range is set on thephotographing range setting screen.

The first imaging unit may be arranged on the same side as that on whichthe first display unit is arranged, in the first body, and the secondimaging unit may be arranged on the same side as that on which thesecond display unit is arranged, in the second body.

The first imaging unit may be arranged on an opposite side to that onwhich the first display unit is arranged, in the first body, and thesecond imaging unit may be arranged on an opposite side to that on whichthe second display unit is arranged, in the second body.

At least one of the first and second imaging units may be rotatable.

The controller may control at least one of the first and second displayunits to display a setting screen for respectively setting functions ofthe first and second display units and separately control displayoperations of the first and second display units according to functionsselected on the setting screen.

If a panorama display function may be set on the first display unit, anda general display function may be set on the second display unit, thecontroller may control to display the panorama image content on thefirst display unit and control to display at least one of image contentsrespectively photographed by the first and second imaging units on thesecond display unit.

The foregoing and/or other features and utilities of the present generalinventive concept may also be achieved by providing a multi displaydevice including a first body which includes a first display unit, asecond body which includes a second display unit, a hinge unit whichconnects the first and second bodies to each other, a first imaging unitwhich is provided in the first body, a second imaging unit which isprovided in the second body, and a controller which controls the firstdisplay unit to display a first live view generated by the first imagingunit and controls the second display unit to display a second live viewgenerated by the imaging unit. If a portion of an overlapping area ofthe first and second live views meets a preset condition, the controllermay respectively control the first and second imaging units to performphotographing and combines photographed images to generate a panoramaimage content.

The foregoing and/or other features and utilities of the present generalinventive concept may also be achieved by providing a multi displaydevice including a first body which includes a first display unit, asecond body which includes a second display unit, a hinge unit whichconnects the first and second bodies to each other, a first imaging unitwhich is provided in the first body, a second imaging unit which isprovided in the second body, and a controller which combines a firstimage photographed by the first imaging unit and a second imagephotographed by the second photographing unit to generate one content.The controller may process the first image as a left eye image andprocess the second image as a right eye image to generate a3-dimensional (3D) image content including the left and right eyeimages.

The controller may control at least one of the first and second displayunits to display a setting screen for respectively setting functions ofthe first and second display units and separately control displayoperations of the first and second display units according to functionsselected on the setting screen.

If a 3D display function is set on the first display unit, and a2-dimensional (2D) function is displayed on the second display unit, thecontroller may control the first display unit to display the 3D imagecontent and control the second display unit to display at least one ofthe left and right eye images.

The foregoing and/or other features and utilities of the present generalinventive concept may also be achieved by providing a photographingmethod of a multi display device which includes a first body including afirst display unit, a second body including a second display unit, and ahinge unit connecting the first and second bodies to each other. Thephotographing method may include performing photographing by using thefirst imaging unit provided in the first body or the second imaging unitprovided in the second body, and combining a plurality of photographedimages to generate a panorama image content. If the first or second bodypivots based on the hinge unit, the photographing may be performed bythe first or second imaging unit.

If the first body pivots in a first direction based on the hinge unit, alive view generated by the first imaging unit may be displayed on thesecond display unit, and the photographing may be performed by using thefirst imaging unit to capture images within a first photographing range.All of the images captured in the first photographing range may beconnected to one another to generate the panorama image content.

If the first body pivots in a first direction based on the hinge unit, alive view generated by the first imaging unit may be displayed on thesecond display unit, and the photographing may be performed by using thefirst imaging unit to capture images within a photographing range. If asecond body pivots in a second direction opposite to the first directionbased on the hinge unit, a live view generated by the second imagingunit may be displayed on the first display unit, and the photographingmay be performed by the second imaging unit to capture images within asecond photographing range. All of the images captured within the firstphotographing range and the images captured within the secondphotographing range may be combined to one another to generate thepanorama image content.

If a particular portion of a subject is recognized in the live view,automatic photographing may be performed.

If an interval angle between the first and second bodies meets a presetcondition, automatic photographing may be performed.

If the pivoting starts, automatic photographing may be performed everypreset time period.

If a panorama photographing mode starts, a photographing range settingscreen may be displayed through at least one of the first and seconddisplay units, and if a photographing range is set on the photographingrange setting screen, photographing angles of the first and secondimaging units may be automatically adjusted according to the setphotographing range.

If a panorama photographing mode starts, a photographing range settingscreen may be displayed through at least one of the first and secondimaging units, and a guide image may be displayed on the first andsecond display units, wherein the guide image induces photographingangles of the first and second imaging units to be adjusted according toa set photographing range if the photographing range is set on thephotographing range setting screen.

The photographing method may further include: displaying a settingscreen for respectively setting functions of the first and seconddisplay units through at least one of the first and second displayunits; and displaying functions selected on the setting screen on thefirst and second display units.

If a panorama display function is set on the first display unit, and ageneral display function is set on the second display unit, the panoramaimage content may be displayed on the first display unit, and at leastone of image contents photographed by the first and second imaging unitsmay be displayed on the second display unit.

The foregoing and/or other features and utilities of the present generalinventive concept may also be achieved by providing a photographingmethod of a multi display device which includes a first body including afirst display unit, a second body including a second display unit, and ahinge unit connecting the first and second bodies to one another. Thephotographing method may include performing photographing by using thefirst imaging unit provided in the first body or the second imaging unitprovided in the second body, and combining a plurality of photographedimages to generate a panorama image content. A first live view generatedby the first imaging unit may be displayed through the first displayunit, a second live view generated by the second imaging unit may bedisplayed through the second display unit, and, if a portion of anoverlapping area between the first and second live views meets a presetcondition, the first and second imaging units may be respectivelycontrolled to perform the photographing.

The foregoing and/or other features and utilities of the present generalinventive concept may also be achieved by providing a photographingmethod of a multi display device which includes a first body including afirst display unit, a second body comprising a second display unit, anda hinge unit connecting the first and second bodies to each other. Thephotographing method may include performing photographing by using thefirst imaging unit provided in the first body and the second imagingunit provided in the second body, and combining a first imagephotographed by the first imaging unit and a second image photographedby the second imaging unit to generate one image content. The firstimage may be processed as a left eye image, and the second image may beprocessed as a right eye image to generate a 3D image content includingthe left and right eye images.

The photographing method may further include: displaying a settingscreen for respectively setting functions of the first and seconddisplay units through at least one of the first and second displayunits; and displaying functions selected on the setting screen on thefirst and second display units.

If a 3D display function is set on the first display unit, and a 2Ddisplay function is displayed on the second display unit, the 3D imagecontent may be displayed on the first display unit, and at least one ofthe left and right eye images may be displayed on the second displayunit.

Accordingly, a multi display device may photograph various types ofphotographed images by using images photographed by using a plurality ofcameras.

The foregoing and/or other features and utilities of the present generalinventive concept may also be achieved by providing a computer-readablemedium to contain computer-readable codes as a program to execute themethod described above or hereinafter.

The foregoing and/or other features and utilities of the present generalinventive concept may also be achieved by providing a multi displaydevice including a first body having a first display unit and a firstimaging unit, a second body having a second display unit and a secondimaging unit, a hinge unit disposed to connect the first and secondbodies to each other, and a controller configured to control at leastone of the first and second imaging units to perform photographing, tocontrol at least one of the first and second imaging units to displayimages generated through the photographing, and to combine the images togenerate an image content.

The image content may be a panorama image content or a 3D image content.

At least one of the first display unit of the first body and the seconddisplay unit of the second body may display a user interface to set oneor more functions of at least one of the first and second imaging units.

The controller may generate a status bar to show a progress andcompletion in generating the image content, and the status bar may bedisplayed on at least one of the first and second display units.

Screens of the first and second display units may be disposed on a sameplane when the first body and the second body are disposed parallel withrespect to the hinge unit.

The second display unit may display the images when the first imagingunit performs the photographing during a movement of the first body withrespect to the second body about the hinge unit.

The first and second bodies may have a same dimension with respect tothe hinge unit.

The first and second bodies may be set in one of different modesaccording to a position state of the first and second bodies withrespect to a reference plane and the hinge unit.

BRIEF DESCRIPTION OF THE DRAWINGS

These and/or other features and utilities of the present generalinventive concept will become apparent and more readily appreciated fromthe following description of the embodiments, taken in conjunction withthe accompanying drawings of which:

FIG. 1 is a block diagram illustrating a structure of a multi displaydevice according to an exemplary embodiment of the present generalinventive concept;

FIGS. 2 through 7 are views illustrating an arrangement of imaging unitsof a multi display device according to various exemplary embodiments ofthe present general inventive concept;

FIGS. 8 and 9 are views illustrating a multi display device including aviewfinder according to an exemplary embodiment of the present generalinventive concept;

FIG. 10 is a view illustrating a photographing method according to anexemplary embodiment of the present general inventive concept;

FIG. 11 is a flowchart illustrating a 3-dimensional (3D) imagephotographing method of a multi display device according to an exemplaryembodiment of the present general inventive concept;

FIG. 12 is a view illustrating a method of setting a depth of a 3D imagecontent according to an exemplary embodiment of the present generalinventive concept;

FIG. 13 is a view illustrating a method of using a depth guide tophotograph a 3D image according to an exemplary embodiment of thepresent general inventive concept;

FIG. 14 is a view illustrating a method of generating a 3D image contentin a multi display device including a rotary imaging unit according toan exemplary embodiment of the present general inventive concept;

FIG. 15 is a view illustrating a method of generating a panorama imagecontent according to an exemplary embodiment of the present generalinventive concept;

FIG. 16 is a view illustrating a method of recognizing a minimumoverlapping area to automatically photograph a panorama image accordingto an exemplary embodiment of the present general inventive concept;

FIG. 17 is a flowchart illustrating a method of capturing a panoramaimage according to an exemplary embodiment of the present generalinventive concept;

FIG. 18 is a view illustrating a method of capturing a panorama image ina single photographing mode according to an exemplary embodiment of thepresent general inventive concept;

FIG. 19 is a view illustrating a method of capturing a panorama image ina multi photographing mode according to an exemplary embodiment of thepresent general inventive concept;

FIG. 20 is a flowchart illustrating a method of capturing a panoramaimage in a multi display device according to another exemplaryembodiment of the present general inventive concept;

FIG. 21 is a view illustrating a method of setting an angle of animaging unit for capturing a panorama image according to an exemplaryembodiment of the present general inventive concept;

FIG. 22 is a view illustrating a method of using an angle guide forcapturing a panorama image according to an exemplary embodiment of thepresent general inventive concept;

FIG. 23 is a view illustrating a method of generating a crop imageaccording to an exemplary embodiment of the present general inventiveconcept;

FIG. 24 is a view illustrating a single mode of a multi display deviceaccording to an exemplary embodiment of the present general inventiveconcept;

FIG. 25 is a view illustrating an expanding mode of a multi displaydevice according to an exemplary embodiment of the present generalinventive concept;

FIGS. 26 through 28 are views illustrating a capturing screen of animaging unit in an expanding mode according to an exemplary embodimentof the present general inventive concept;

FIG. 29 is a view illustrating a method of selecting a screen frameaccording to an exemplary embodiment of the present general inventiveconcept;

FIGS. 30 and 31 are views illustrating an operation of a multi displaydevice according to another exemplary embodiment of the present generalinventive concept;

FIG. 32 is a view illustrating a toolkit mode of a multi display deviceaccording to an exemplary embodiment of the present general inventiveconcept;

FIGS. 33 through 35 are views illustrating a screen frame in a toolkitmode according to an exemplary embodiment of the present generalinventive concept;

FIG. 36 is a view illustrating a video call function of a multi displaydevice according to an exemplary embodiment of the present generalinventive concept;

FIG. 37 is a view illustrating a video call function of a multi displaydevice including a rotary imaging unit according to an exemplaryembodiment of the present general inventive concept;

FIG. 38 is a view illustrating a standing mode of a multi display deviceaccording to an exemplary embodiment of the present general inventiveconcept;

FIGS. 39 and 40 are views illustrating a screen frame in a standing modeaccording to an exemplary embodiment of the present general inventiveconcept;

FIG. 41 is a view illustrating a standing mode of a multi display deviceaccording to another exemplary embodiment of the present generalinventive concept;

FIG. 42 is a block diagram illustrating a detailed structure of a multidisplay device according to an exemplary embodiment of the presentgeneral inventive concept;

FIG. 43 is a block diagram illustrating a detailed structure of a multidisplay device according to another exemplary embodiment of the presentgeneral inventive concept;

FIG. 44 is a block diagram illustrating a structure of a multi displaydevice that controls operations of display units by using a plurality offrame buffers according to an exemplary embodiment of the presentgeneral inventive concept;

FIG. 45 is a block diagram illustrating a structure of a multi displaydevice that controls operations of display units by using an integratedframe buffer according to an exemplary embodiment of the present generalinventive concept;

FIG. 46 is a view illustrating a detailed structure of a first displayunit of two display units illustrated in FIG. 44;

FIG. 47 is a view illustrating a circuit structure constituting R, G,and B pixels constituting a display panel illustrated in FIG. 46;

FIG. 48 is a view illustrating a system hierarchy structure of a multidisplay device according to an exemplary embodiment of the presentgeneral inventive concept;

FIGS. 49 and 50 are views illustrating a method of sensing a proximitytouch according to an exemplary embodiment of the present generalinventive concept;

FIG. 51 is a flowchart illustrating a photographing method of a multidisplay device according to an exemplary embodiment of the presentgeneral inventive concept;

FIG. 52 is a flowchart illustrating a photographing method of a multidisplay device according to another exemplary embodiment of the presentgeneral inventive concept; and

FIG. 53 is a flowchart illustrating a photographing method of a multidisplay device according to another exemplary embodiment of the presentgeneral inventive concept.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Reference will now be made in detail to the embodiments of the presentgeneral inventive concept, examples of which are illustrated in theaccompanying drawings, wherein like reference numerals refer to the likeelements throughout. The embodiments are described below in order toexplain the present general inventive concept while referring to thefigures.

The matters defined in the description, such as detailed constructionand elements, are provided to assist in a comprehensive understanding ofthe exemplary embodiments. Thus, it is apparent that the exemplaryembodiments can be carried out without those specifically definedmatters. Also, well-known functions or constructions are not describedin detail since they would obscure the exemplary embodiments withunnecessary detail.

In the present specification, a multi display device includes aplurality of display units and displays various types of screens throughthe display units. In detail, the multi display device may be realizedas a type such as a tablet personal computer (PC), a portable multimediaplayer (PMP), a personal digital assistant (PDA), a smart phone, aportable phone, a digital frame, a game machine, or the like.

FIG. 1 is a block diagram illustrating a structure of a multi displaydevice 100 according to an exemplary embodiment of the present generalinventive concept.

Referring to FIG. 1, the display device 100 includes a first body 2, asecond body 4, and a hinge unit 185. The first body 2 is referred to asone independent external structure including a first imaging unit 140 aand a display unit 190 a, and the second body 2 is also referred to asanother independent external structure including a second imaging unit140 b and a second display unit 190 b.

A controller 130 may be included in the second body 4 or a plurality ofcontrollers 130 may be installed to be included in both the first andsecond bodies 2 and 4. When the controller 130 is included in the secondbody 4, the controller 130 may control both the first body 2 and thefirst body 4. When the plurality of controllers 130 are included in thefirst and second bodies 2 and 4, at least one of the plurality ofcontrollers 130 may control both the first and second bodies 2 and 4.The first and second bodies 2 and 4 may further include various types ofcircuits, chips, signal lines, etc. besides illustrated elements. Forconvenience of description, illustrations of detailed elements will beomitted.

The first and second bodies 2 and 4 are connected to each other throughthe hinge unit 185. The hinge unit 185 supports the first and secondbodies 2 and 4 so that the first and second bodies 2 and 4 pivot on thehinge unit 185. Rotation angles of the first and second bodies 2 and 4may be variously determined with respect to each other or a referenceplane according to a shape of the hinge unit 185.

For example, when one of the first and second bodies 2 and 4 pivots, thefirst and second display units 190 a and 190 b may be closed in contactwith each other to be folded in a direction such that front surfaces ofthe first and second display units 190 a and 190 b face or contact eachother and rear surfaces thereof are opened, or the first and seconddisplayed units 190 a and 190 b may be closed in contact with each otherto be folded in an opposite direction such that rear surfaces of thefirst and second display units 190 a and 190 b face or contact eachother and the front surfaces thereof are opened. Alternatively, thefirst and second display units 190 a and 190 b may be disposed at aplane to form an angle of 180° to be opened according to a structure ofthe hinge unit 185. Shapes of the first and second bodies 2 and 4 thatare unfolded based on the hinge unit 185 will be described in detail invarious exemplary embodiments that will be described later.

The controller 130 controls an operation of the multi display device 100according to various user's controls such as user's touches on the firstand second display units 190 a and 190 b, selections of buttons of thefirst and second bodies 2 and 4, user's gestures, voice commands, etc.If power buttons are provided on the first and second bodies 2 and 4,the controller 130 may perform a turn-on operation or a turn-offoperation according to selections of the power buttons. It is possiblethat when one of the power buttons is selected, a corresponding one ofthe first and second bodies 2 and 4 is turned on and off. It is alsopossible that when a power button of the second body 4 is selected, boththe first and second bodies 2 and 4 are turned on or off when thecontroller 130 is disposed in the first body 2 to control both the firstand second bodies 2 and 4. It is also possible that when a power buttonof the first body 2 is selected, the first body may be turned on or off.If a power button is provided on one of the first and second bodies 2and 4, the controller 130 may perform a turn-on and off operation of thefirst and second bodies 2 and 4. If menus are displayed on screens ofthe first and second display units 190 a and 190 b, and a user touchesthe menus, the controller 130 may perform operations corresponding tothe touched menus.

Also, the controller 130 displays various types of screens by using atleast one of the first and second display units 190 a and 190 b. In thiscase, the first and second display units 190 a and 190 b may display onescreen together and may separately display different screens. Thecontroller 130 selectively activates the first and second display units190 a and 190 b according to various conditions, such as an executionapplication, a type of content, a selection of the user, etc., todisplay various types of screens. A structure of a device including twodisplay units like the first and second display units 190 a and 190 b isillustrated in FIG. 1, and thus the device may be referred to as a dualdisplay device. However, the number of display units may be 2, 3, ormore, and thus for convenience of description, the device may bereferred to a multi display device herein.

First and second imaging units 140 a and 140 b are respectivelyinstalled in the first and second bodies 2 and 4. The first and secondimaging units 140 a and 140 b respectively include cameras. Each of thecameras includes a lens and an image sensor.

As described above, the multi display device 100 includes the pluralityof imaging units 140 a and 140 b and the plurality of display units 190a and 190 b. Therefore, the controller 130 controls the imaging units140 a and 140 b and the display units 190 a and 190 b to perform varioustypes of photographing

For example, the controller 130 may combines images respectivelyphotographed by the first and second imaging units 140 a and 140 b togenerate one image content. The one image content may be a 3-dimensional(3D) image content or a panorama image content. A depth may be appliedto a subject by using a binocular parallax between the first and secondimaging units 140 a and 140 b with respect to the subject to3-dimensionally recognize the 3D image content. Images respectivelyphotographed from the first and second imaging units 140 a and 140 b tobe disposed side to side or above and below may be continuouslyconnected to each other to generate the panorama image content.

The controller 130 may also perform various types of photographingoperations according to exemplary embodiments. The controller 130 maycontrol a photographing operation based on an angle formed between thefirst and second bodies 2 and 4, additional information, other usercommands, etc.

This photographing operation may be differently realized according tothe number of imaging units and shapes and arrangement positions of thephotographing units.

The block diagram of the multi display device 100 of FIG. 1 includes thefirst and second imaging units 140 a and 140 b but may further includethird and fourth imaging units. Therefore, the controller 130 maycontrol the number of divided screens of the first and second displayunits 140 a and 140 b and a method of dividing screens of the first andsecond display units 140 and 140 b according to the number of imagingunits that are activated. The controller 130 may also control the firstand second imaging units 104 a and 140 b to perform different functions.For example, a still image capturing function may be applied to thefirst imaging unit 140 a, and a moving picture image generating functionmay be allocated to the second imaging unit 140 b. Alternatively, ageneral photographing function may be allocated to the first imagingunit 140 a, and a zoom photographing function may be allocated to thesecond imaging unit 140 b.

Accordingly, before various exemplary embodiments related to aphotographing operation are described, various exemplary embodimentsrelated to arrangements of imaging units will be first described.

FIGS. 2 through 7 are views illustrating arrangements of imaging unitsof a multi display device according to various exemplary embodiments ofthe present general inventive concept. For convenience of description,illustrations of parts that are not related to descriptions of thearrangements of the imaging units are simplified or omitted in FIGS. 2through 7. However, when the imaging units are realized as realproducts, buttons, speakers, microphones, and other elements may befurther included. The multi display apparatus of FIGS. 2 through 7 maybe the multi display device 100 of FIG. 1, for example. However, thepresent general inventive concept is not limited thereto. A multidisplay device having the controller 130 included in the second body 4or various types of multi display devices, for example, having aplurality of controllers 130, can be used as the multi display apparatusof FIGS. 2 through 7.

Referring to FIG. 2, the multi display apparatus 100 includes the firstand second bodies 2 and 4. The first body 2 includes the first displayunit 190 a, and the second body 4 includes the second display unit 190b. The first and second bodies 2 and 4 are connected to each otherthrough the hinge unit 185 to relatively move.

A first imaging unit 141 is arranged in a center of an edge area of thefirst body 2 that is opposite to the hinge unit 185 with respect to acenter of the first body 2. The second imaging unit 142 is arranged in acenter of an edge area of the second body 4 that is opposite to thehinge unit 185 with respect to a center of the second body 4. The firstimaging unit 141 is disposed on a side formed with a display area of thefirst display unit 190 a or a side area surrounding the display area ofthe first display unit 190 a. The edge area may be referred to as aportion of the side area. Here, when an imaging unit is arranged in anarea of a body, the imaging unit is disposed to photograph an objectpositioned in a front portion of the area of the body. However, thepresent general inventive concept is not limited thereto. It is possiblethat an imaging unit has a structure and function to photograph bothsides of the body. That is, the image unit may photograph an objectpositioned in a front portion of one side of the body in a firstphotographing mode or an object positioned a rear portion of the otherside of the body in a second photographing mode according to a user ordesign preference. In this case, when the imaging unit is arranged in anarea of a body, the imaging unit may have a primary photographing modeto photograph an object positioned in front of the area of the body.

FIG. 3 illustrates another arrangement of imaging units. For convenienceof description, the arrangements of the imaging units will be describedbased on a direction in which the user watches the multi display device100. A first imaging unit 141′ is arranged in a center of a left edgearea of the first body 2, and a second imaging unit 142′ is arranged ina center of a left edge area of the second body 4. According to anotherexemplary embodiment, it is possible that the first and second imagingunits 141′ and 142′ may be respectively arranged in centers of rightedge areas of the first and second bodies 2 and 4. According to anotherexemplary embodiment, it is also possible that the first and secondimaging units 141′ and 142′ may be respectively arranged in corner areasof the first and second bodies 2 and 4. The multi display device 100 maybe used in a horizontal direction or in a vertical direction in whichthe first and second imaging units 141 (141′) and 142 (142′) aredisposed as illustrated in FIG. 2 or 3.

FIG. 4 is a view illustrating a multi display device including displayunits 190 a and 190 b arranged (disposed) on sides of the first andsecond bodies 2 and 4 and imaging units 141 a and 142 a arranged(disposed) on opposite sides thereof according to an exemplaryembodiment of the present general inventive concept. The first andsecond imaging units 141 a and 142 a are respectively arranged in edgeareas of the sides of the first and second bodies 2 and 4 that areopposite to the sides of the first and second bodies 2 and 4 on whichfirst and second display units 190 a and 190 b are arranged. However,the arrangements of the first and second imaging units 141 a and 142 aare not limited to positions illustrated in FIG. 4. If the first andsecond imaging units 141 a and 142 a are arranged on the sides that areopposite to the sides on which the first and second display units 190 aand 190 b are arranged, the user may simultaneously photograph a subjectand check live view screens respectively displayed on the first andsecond display units 190 a and 190 b.

FIG. 5 is a view illustrating the multi display device including threeimaging units according to an exemplary embodiment of the presentgeneral inventive concept. Referring to FIG. 5, the first body 2 has afirst display device 190 a and a first imaging unit 141 arranged on asame side of the first body 2. The second body 4 has a second displayunit 190 b and a second imaging unit 142 arranged on a same side of thesecond body 4. A third imaging unit 146 is arranged on a side of thesecond body 4 opposite to that of the second body 4 on which the seconddisplay unit 190 b is arranged. The multi display device 100 in whichthe first and second imaging units 141 and 142 are arranged in centersof edge areas opposite to each other with respect to the hinge unit 185is illustrated in FIG. 5. However, the present general inventive conceptis not limited thereto For example, the first and second imaging units141 and 142 may be respectively arranged in centers of edge areas of oneof sides of the first and second bodies 2 and 4 or in corner areas thatdo not contact the hinge unit 185 (or are disposed away from the hingeunit 185 by a distance). The arrangement of the third imaging unit 146may not be limited to a corner area of a side of the second body 4 thatis opposite to the side of the second body 4 on which the second displayunit 190 b is arranged. The third imaging unit 146 may be arranged in acorner area of a side of the second body 4 that is opposite to the sideon which the second display unit 190 b is arranged or in a center of anedge area that does not contact the hinge unit 185. The third imagingunit 146 may be arranged on a side of the first body 2 that is oppositeto a side of the first body 2 on which the first display unit 190 a isarranged.

FIG. 6 is a view illustrating a multi display device including fourimaging units according to an exemplary embodiment of the presentgeneral inventive concept.

Referring to FIG. 6, first and second imaging units 141 and 142 arerespectively arranged in centers of edge areas of the first and secondbodies 2 and 4 that do not contact the hinge unit 185. The edge areas ofsides of the first and second bodies 2 and 4 are respectively disposedon a same side of the first and second bodies 2 and 4 as the first andsecond display units 190 a and 190 b are arranged. Third and fourthimaging units 143 and 144 are respectively arranged on sides of thefirst and second bodies 2 and 4 that are opposite to the first andsecond display units 190 a and 190 b. The first, second, third, andfourth imaging units 141, 142, 143, and 144 are not limited toarrangement positions illustrated in FIG. 6.

If three or more multi imaging units are arranged, two of the threemulti imaging units arranged on the same side may be used to generate a3-dimensional (3D) or panorama image content, and the other imaging unitmay be used to photograph an image, a moving picture, etc.

FIG. 7 is a view illustrating a multi display device including rotaryimaging units according to an exemplary embodiment of the presentgeneral inventive concept.

Referring to FIG. 7, a first rotary imaging unit 148 is arranged in acenter of an edge area of the first body 2 that is opposite to the hingeunit 185 with respect to the first display unit 190 a. A second rotaryimaging unit 149 is arranged in a center of an edge area of the secondbody 4 that is opposite to the hinge unit 185 with respect to the seconddisplay unit 190 b. The first and second rotary imaging units 148 and149 may be respectively connected to the first and second bodies 2 and 4through a pivotable hinge element. Therefore, the first and secondrotary imaging units 148 and 149 may rotate within a predetermined anglerange. The first and second bodies 2 and 4 have a portion formed in aside area to accommodate the first and second rotary imaging units 148and 149, respectively. The pivotable hinge element is rotatably disposedto connect the first and second rotary imaging units 148 and 149 to thefirst and second bodies, respectively. A photographing angle of thefirst and second rotary imaging unit 148 and 149 may be variableaccording a rotation angle of the first and second rotary imaging units148 and 149 with respect to the first and second bodies 2 and 4,respectively. An electrical line may be disposed through the hingeelement or in the portion to provide electrical connection between acontroller of the first and second bodies 2 and 4 and the first andsecond rotary imaging units 148 and 149, respectively.

A method of rotating rotary imaging units may be a manual method ofdirectly rotating the rotary imaging units by a user or an automaticmethod of rotating the rotary imaging units by using a preset value in apreset condition. The pivotable hinge element may have an electricalcomponent to be controlled by a controller of the first and second bodes2 and 4 to rotate the first and second rotary imaging units 148 and 149with respect to the first and second bodies 2 and 4, respectively.Alternatively, the imaging units may be rotated by using both of themanual method and the automatic method. At least one of first and secondrotary imaging units may automatically or manually rotate toward a sidethat is opposite to display units or may be automatically or manuallyrotate toward the same side as the display units to recognize a spacegesture.

The space gesture refers to an operation of operating the multi displaydevice by using a predetermined motion of a user object on a spacewithout a physical contact such as a touch of a touch screen or pressingof a button. The space gesture may be captured or detected by a unit(not illustrated) of the multi display device to control a movement, arotation angle, a function of the imaging unit according to the spacegesture.

As described above, the number of imaging units and arrangementpositions of the imaging units may be variously realized according toexemplary embodiments. However, the number of imaging units is notlimited to the number illustrated in the above-described drawings, andthe arrangement positions of the imaging units are also not limited tothe above-described arrangement positions.

The controller 130 displays a live-view corresponding to light incidentthrough imaging units on at least one of the first and second displayunits 190 a and 190 b. Therefore, the controller 130 allows the user toperform capturing during watching the live view. However, if imagingunits and display units are arranged on the same side as illustrated inFIG. 2 or 3, the user may not watch the live view due to a position ofthe user. Therefore, a viewfinder or an additional display may befurther included to cope with this situation.

FIGS. 8 and 9 are views illustrating a multi display device including aviewfinder according to an exemplary embodiment of the present generalinventive concept. The multi display apparatus of FIGS. 8 and 9 may bethe multi display device 100 of FIG. 1, for example.

Referring to FIG. 8, a hinge unit 185 a of the multi display device 100includes a viewfinder 11 a. The viewfinder 11 a allows a user to see animage or a composition to be photographed when the user photographs asubject by using an imaging unit. If first and second imaging units 141and 142 are respectively arranged on the same sides as first and seconddisplay units 190 a and 190 b as illustrated in FIG. 8, and the userforces the first and second imaging units 141 and 142 to face thesubject in order to photograph the subject, the first and second displayunits 190 a and 190 b are disposed to face the subject. Therefore, itmay be inconvenient for the user to recognize which image is to bephotographed. If a viewfinder is used, the user may recognize whichimage is photographed through the viewfinder, and thus the above problemmay be solved.

According to an exemplary embodiment, the hinge unit 185 a may have ahole formed therein, and the viewfinder 11 a may be formed in a holeshape corresponding to the hole and having a space with a predeterminedsize to be disposed in the hole of the hinge unit 185 a. The firstimaging units 141 and 142 and the viewfinder 11 a are respectivelyfixedly arranged in the first and second bodies 2 and 4 and the hingeunit 185 a. Therefore, the composition of the subject seen through theviewfinder 11 a nearly matches with an image photographed by the firstand second imaging units 141 and 142. The size of the space of theviewfinder 11 a may be adjusted or arrangement positions of the firstand second imaging units 141 and 142 may be adjusted to match thecomposition of the subject seen through the viewfinder 11 a with theimage photographed by the first and second imaging units 141 and 142.The first and second bodies 2 and 4 may be rotatable with respect to thehinge unit 185 a, and the viewfinder 11 a may be fixedly disposed in thehinge unit 185 a. However, the present general inventive concept is notlimited thereto. That is, the viewfinder 11 a may be movably disposed inthe hinge unit 185 a.

According to another exemplary embodiment, the viewfinder 11 a may be asub display module according to a design or user preference. In thiscase, the sub display module may display the same images as displayed onthe first and second display units 190 a and 190 b. The viewfinder 11 ais not limited to positions of images illustrated in FIG. 8 and thus maybe included in the first body 2 or the second body 4.

Referring to FIG. 9, a viewfinder 11 b may be formed in a structure thatmay be disposed to move, for example, slide up or down on a hinge unit185 b. The viewfinder 11 b may move to be extended or disposed higherthan a top side of the first and second bodies 2 and 4. As describedabove with reference to FIG. 8, the viewfinder 11 b observing a subjectmay be manufactured in a hole shape having a space with a predeterminedsize. The viewfinder 11 b may be formed as a sub display module. The subdisplay module may be realized as various types of display technologiessuch as a liquid crystal display (LCD) panel, a plasma display panel(PDP), an organic light-emitting diode (OLED), a vacuum fluorescentdisplay (VFD), a field emission display (FED), an electroluminescencedisplay (ELD), a transparent display panel, etc.

According to an exemplary embodiment, the viewfinder 11 b may have astructure to move the viewfinder 11 b with respect to the hinge unit 185b or the first and second bodies 2 and 4. The structure may include afirst rail installed on a side that is opposite to a side on which firstand second display units 190 a and 190 b are arranged, and a second railinstalled at left and right ends of the viewfinder 11 b to make a pairwith the first rail to combine the viewfinder 11 b with the hinge unit185 b.

According to another exemplary embodiment, the viewfinder 11 b may becombined with the hinge unit 185 b in a structure, an end of whichpivots. If necessary, the viewfinder 11 b may 180° rotate to protrudefrom the hinge unit 185 b.

According to another exemplary embodiment, the viewfinder 11 b may beformed in a center of a side of the hinge unit 185 b in a shape thatpops up toward an axis dividing the first and second display units 190 aand 190 b. In a method of popping up the viewfinder 11 b, the viewfinder11 b may be manually popped up and down. In other words, if theviewfinder 11 b is pressed once when the viewfinder 11 b is popped down,the viewfinder 11 b is popped up. If the viewfinder 11 b is pressed oncewhen the viewfinder 11 b is popped up, the viewfinder 11 b is poppeddown. An appropriate part, such as a spring, a button, or the like, maybe added for the above-described operation.

As described above, the numbers and positions of imaging units andviewfinders used for a capturing operation may be variously changedaccording to exemplary embodiments. Therefore, the capturing operationusing these imaging units may be variously performed. Capturingoperations according to various exemplary embodiments of the presentgeneral inventive concept will now be described.

FIG. 10 is a view illustrating a photographing method according anexemplary embodiment of the present general inventive concept. Indetail, FIG. 10 is a view illustrating a method of photographing a 3Dimage contents.

A user may see an object with both left and right eyes. The left andright eyes keep a predetermined distance from each other and thus acceptthe same object as two images having different angles. A cerebrumaccepting the two images having the different angles recognizes the twoimages as one image and 3-dimensionally feels the object in thisprocess.

Referring to FIG. 10, first and second imaging units 141 a and 142 aimage a subject A. Based on a direction in which a user watches asubject, the first imaging unit 141 a is positioned on a left side ofthe subject A, and thus an image seen in a left direction isphotographed. Since the second imaging unit 142 a is positioned on aright side of the subject A, an image seen in a right direction isphotographed. A distance between the first and second imaging units 141a and 142 a is referred to as a parallax. Also, two images generatingthe parallax are combined into one image content to generate a 3D imagecontent 21. In detail, the two images may be combined by using atop-to-bottom method or a side-by-side method to generate the 3D imagecontent 21. Here, the top-to-bottom method is to connect a first imagephotographed by the first imaging unit 141 a and a second imagephotographed by the second imaging unit 141 b above and below. Also, theside-by-side method is to connect the first and second images from sideto side.

A display unit may be manufactured according to a particular method toallow a user to further feel a 3D effect on the 3D image content 21. Forexample, a barrier may be formed on a display panel to allow both eyesof a user to see different pixels. As the both eyes see the differentpixels through the barrier, a depth of an image is generated so that auser feels a 3D effect. The depth refers to a degree of a 3D effectappearing through a binocular parallax. As another example, the displaypanel may include a small lens. If the user watches an image displayedon a display unit, left and right eyes of the user watch differentpixels due to a binocular parallax and a refraction of a lens.Therefore, a depth of the image occurs, and thus the user feels a 3Deffect. As a result, the 3D effect may vary according to the depth. Thedepth is determined by an angle difference between photographing rangesof the first and second imaging units 141 a and 142 a. Accordingly, theuser manually pivots at least one of the first and second bodies 2 and 4based on the hinge unit 185 to adjust the at least one so as to secure adesired depth and then performs photographing.

In this case, the user may undergo trials and errors, such as severalrepetitions, to adjust a depth of a 3D image content to a desired size.Therefore, according to another exemplary embodiment of the presentgeneral inventive concept, a depth setting mode may be provided to allowthe user to set a desired depth and perform photographing according tothe set depth.

FIG. 11 is a flowchart illustrating a method of photographing a 3D imageof a multi display device according to an exemplary embodiment of thepresent general inventive concept.

Referring to FIG. 11, the multi display device supports a depth settingmode. In operation S1110, a controller determines whether the depthsetting mode has been selected. For example, if a user selects a settingmenu corresponding to the depth setting mode, the multi display devicemay display a depth setting screen. The user may set a depth on thedepth setting screen, and the multi display device determines that thedepth setting mode has been selected. The depth setting mode refers to amode in which the user selects a depth of a 3D image content to adesired size.

If a distance between two imaging units is adjusted, a parallax ischanged, and thus a depth is adjusted. In operation S1130, the userperforms photographing without setting the depth or may set a desireddepth to perform photographing. For example, the depth may be dividedinto deep, normal, and shallow levels or may be divided into levels tobe classified according to numbers. It is possible that the depth may bemanually set by a user or that a user controls an angle between theimaging units to adjust the depth. The angle may be a photographingangle formed between a first line connecting a subject and one of theimaging units and a line connecting the subject and the other one of theimaging units.

As described above, the depth is formed by a parallax of the two imagingunits, and thus the imaging units are adjusted so that a distancebetween the imaging units corresponds to the set depth. Therefore, inoperation S1120, the controller displays a photographing angle adjustingguide. The photographing angle adjusting guide may include degrees ofthe imaging units to be moved, displayed to the user through the displayunit. Alternatively, an angle between the imaging units may bedisplayed, and a depth degree corresponding to the angle between theimaging units may be displayed.

If the adjusting of the angle is completed, the multi display deviceperforms photographing according to an input of a photographing commandof the user in operation S1130. In operation S1140, the controller 130combines two images to generate a 3D image content. The 3D image contentmay be generated in a basic depth according to a photographing parallaxof the two imaging units or may be generated by changing depth levels byusing a corresponding method.

As described above, the controller 130 monitors an interval angle toprovide a depth guide corresponding to the interval angle. In this case,the multi display device may include a hinge unit sensor. The hinge unitsensor senses the interval angle formed between reference planes offirst and second bodies based on a hinge unit.

The controller 130 performs the depth setting mode based on a sensingvalue of the hinge unit sensor. If a depth is set, the controller 130determines an interval angle corresponding to the set depth and displaysa depth guide corresponding to the interval angle. Therefore, if theuser pivots the first or second body, the controller 130 measures theinterval angle by using the hinge unit sensor. The controller 130changes the depth guide or ends displaying of the depth guide accordingto the measurement result.

An operation of setting a depth in a multi display device in which auser manually pivots a body has been described above. However, accordingto another exemplary embodiment of the present general inventiveconcept, the multi display device may automatically pivot at least oneof the bodies to adjust the depth. For example, the multi display devicemay further include a hinge unit actuator (not illustrated). The hingeunit actuator is an element that pivots the first or second body basedon a rotation shaft.

If one depth is selected on the depth setting screen, the controller 130actuates the hinge unit actuator to form an interval angle correspondingto the selected depth in order to pivot the first or second body.

FIG. 12 is a view illustrating a method of setting a depth of a 3D imagecontent according to an exemplary embodiment of the present generalinventive concept.

Referring to FIG. 12, a first display unit 190 a displays a depthsetting screen 31. The depth setting screen 31 may be displayed in apop-up window form or may be displayed in a bar form in a predeterminedspace of the first display unit 190 a. The depth setting screen 31having the pop-up window form may be displayed transparently orsemi-transparently. The first display unit 190 a may display only thedepth setting screen 31 or may display a screen photographed by a firstimaging unit and display the depth setting screen 31 on the screen. Forexample, the depth setting screen 31 may be displayed in deep, normal,shallow levels or levels of the depth setting screen 31 may be displayedby using numbers according to a depth degree

A second display unit 190 b displays a live view screen generated by asecond imaging unit. The second display unit 190 b may display only ascreen photographed by the second imaging unit on an entire screen ormay divide the screen into two areas to display screens photographed bythe first and second imaging units. Alternatively, the second displayunit 190 b may generate and display images photographed by the first andsecond imaging units as a 3D image content.

FIG. 13 is a view illustrating a method of using a depth guide tophotograph a 3D image according to an exemplary embodiment of thepresent general inventive concept.

Referring to FIG. 13, a first display unit 190 a displays a depth guide33. The depth guide 33 may be expressed as various graphic objects suchas a text, a symbol, a number, etc. As described above, a depth may beset to various levels on a depth setting screen. For example, the depthmay be set to one of three levels such as deep, normal, and shallowlevels or to one of levels classified according to numbers like firstlevel through fifth level. An angle between first and second bodies isdifferently determined according to each depth level. Therefore, thecontroller 130 generates the depth guide 33 that induces at least one ofthe first and second bodies to pivot by a pivoting angle correspondingto a depth level selected in the depth setting mode.

Referring to FIG. 13, the depth guide 33 is displayed in a text form tocause the first or second body to pivot further forward or backward. Auser may pivot or move the first body 2 forward according to aninstruction of the depth guide 33. If it is determined that the firstbody 2 has pivoted by a predetermined angle, the controller 130 maychange the depth guide 33 into a message indicating a photographablestatus and display the message. Alternatively, differently from FIG. 12,the depth guide 33 may directly indicate a pivot angle like “pivotforward by 10°”. In this case, if the user pivots the first body 2forward, the controller 130 may update the depth guide 33 according tothe pivoting angle. The depth guide 33 may include the angle to bevariable according to a current angle between the first and secondimaging units. Therefore, the depth guide 33 may include at least one ofa level of a desired depth, a desirable angle corresponding to thedesired depth, and an instruction to show an angle variable according tothe angle and a current angle.

According to another exemplary embodiment of the present generalinventive concept, if the user pivots a body according to the depthguide 33 and then forms a pivoting angle matching with a set depth, thecontroller 130 may automatically perform a photographing operation.

In FIG. 13, the depth guide 33 is displayed only on the first displayunit 190 a, and the live view of a subject is displayed on the seconddisplay unit 190 b. However, the depth guide 33 may overlap with thelive view to be displayed or may be displayed on both of the first andsecond display units 190 a and 190 b.

The second display unit 190 b may display the same screen as thatdescribed with reference to FIG. 12. The screens displayed on the firstand second display units 190 a and 190 b of FIGS. 12 and 13 may bedisplayed on opposite display units.

In general, for 3D photographing, a central line between two imagingunits is kept horizontal with respect to a subject. However, althoughthe central line between the two imaging units is not horizontalaccording to a distance of the subject, 3D photographing is possible upto a predetermined angle. However, a rotary imaging unit may keephorizontal with respect to a subject and thus may generate a 3D imagecontent having further various depths.

FIG. 14 is a view illustrating a method of generating a 3D image contentin a multi display device including rotary imaging units according to anexemplary embodiment of the present general inventive concept.

Referring to a view (1) of FIG. 14, a first rotary imaging unit 148 isinstalled in a first body 2, and a second rotary imaging unit 149 isinstalled in a second body 4. A distance between the first and secondrotary imaging units 148 and 149 is changed according to changes ofangles of the first and second bodies 2 and 4. However, since the firstand second rotary imaging units 148 and 149 pivot, a central linebetween the first and second rotary imaging units 148 and 149 may facefrontwards. A view (2) of FIG. 14 illustrates the above-describedcontents. Therefore, a 3D image content may be generated regardless ofthe angles of the first and second bodies 2 and 4. However, if theangles of the first and second bodies 2 and 4 are approximate 0° withrespect to a reference, the first and second rotary imaging units 148and 149 may photograph images to generate a 3D image content having ashallow depth. If the angles of the first and second bodies 2 and 4 areapproximate 180° with respect to the reference, the first and secondrotary imaging units 148 and 149 may photograph images to generate a 3Dimage content having a deep depth.

The first and second rotary imaging units 148 and 149 may be manuallyrotated, for example, may be automatically rotated if a predeterminedangle is input.

A multi display device that generates a 3D image content by using aplurality of imaging units according to various exemplary embodimentshas been described. A method of generating a panorama image contentaccording to various exemplary embodiments will now be described.

FIG. 15 is a view illustrating a method of generating a panorama imagecontent according to an exemplary embodiment of the present generalinventive concept.

Referring to FIG. 15, first and second imaging units 141 a and 142 bperform photographing with respect to a subject “ABC”. A first displayunit 190 a displays an image photographed by the first imaging unit 141a, and a second display unit 190 b displays an image photographed by thesecond imaging unit 142 a. In other words, the first display unit 190 adisplays “AB”, and the second display unit 190 b displays “BC”. Anoverlapping portion is required to generate a panorama image. In FIG.15, an area “B” is an overlapping portion. The controller 130 detectsoverlapping portions between images photographed by two imaging unitsand overlaps the overlapping portions with each other to generate apanorama image 35 of ABC. The panorama image 35 may replace thedisplayed images. It is possible that the panorama image 35 may bedisplayed on at least one of the first and second display units 190 aand 190 b according to a user selection or an option setting. The userselection or the option setting may be set using a user interfacedisplayed on at least one of the first and second display units 190 aand 190 b. In FIG. 15, the images photographed by the first and secondimaging units 141 a and 142 a are respectively displayed on the firstand second display units 190 a and 190 b. However, the first and seconddisplay units 190 a and 190 b may be recognized as one whole screen, andthe whole screen may be divided into upper and lower screens to displaythe photographed images.

Photographing for generating a panorama image content may be performedaccording to a selection of a user or may be automatically performed ifa preset condition is satisfied.

FIG. 16 is a view illustrating a method of recognizing a minimumoverlapping area to automatically photograph a panorama image accordingto an exemplary embodiment of the present general inventive concept.

Referring to a view (1) of FIG. 16, a multi display device photographs asubject “ABCD”. A first display unit 190 a displays “ABC” according toangles of first and second bodies, and a second display unit 190 bdisplays “BCD”. In other words, a portion “BC” is an overlapping area.

Referring to a view (2) of FIG. 16, the angles of the first and secondbodies are adjusted, and thus images photographed by first and secondimaging units have a minimum overlapping area. In detail, the firstdisplay unit 190 a displays “AB”, and the display unit 190 b displays“CD”. The imaging units automatically perform photographing in thismoment.

The minimum overlapping area refers to a minimum area that is overlappedin images photographed by the first and second imaging units.

The minimum overlapping area indicates that the images photographed bythe first and second imaging units continue without overlap with eachother. In order to check the overlapping area, the controller 130divides each of the images photographed by the first and second imagingunits into a plurality of blocks and check pixel values of pixels of theblocks. For example, if each of the images is divided into a pluralityof blocks including n×m pixels, the controller 130 calculates an averagevalue or a sum value of pixels of each of the blocks and sets thecalculation result value to a representative block value. Here, n and mare a natural number. The controller 130 compares a representative valueof each block of a first image photographed by the first imaging unitwith a representative value of each block of a second image photographedby the second imaging unit to determine that blocks having values withina preset error range overlap with one another.

The controller 130 may determine a ratio of a predetermined overlappingarea of one image and, if the ratio of the predetermined overlappingarea is within a preset ratio, recognizes the predetermined overlappingarea as a minimum overlapping area. Alternatively, the controller 130may determine predetermined areas of imaging units and, if anoverlapping area of photographed images is within a preset area,recognize the overlapping area as a minimum overlapping area.

The controller 130 may control the imaging units to perform automaticphotographing by using other conditions. For example, the imaging unitsmay perform the automatic photographing by using recognitions of aparticular portion of a subject, angles and predetermined periods offirst and second imaging units, etc. As one example, automaticphotographing using a recognition method of recognizing a particularportion of a subject indicates that a shape or a face of a human isrecognized to be automatically photographed.

If first and second imaging units are fixedly disposed in thecorresponding bodies, there are several methods of photographing apanorama image. A method of photographing a panorama image according tovarious exemplary embodiments of the present general inventive conceptwill now be described.

FIG. 17 is a flowchart illustrating a method of photographing a panoramaimage in a multi display device according to an exemplary embodiment ofthe present general inventive concept.

Referring to FIG. 17, in operation S1710, the controller 130 determineswhether a multi display device is in an automatic panorama mode. Theautomatic panorama mode refers to a mode in which imaging unitsautomatically perform photographing according to preset conditions. Forexample, the preset conditions may include a predetermined period,predetermined angles of first and second imaging units, a recognition ofa particular portion of a subject, a recognition of a minimumoverlapping area, the number of frames to be photographed, etc.

If the multi display device is set to the automatic panorama mode, thecontroller 130 transmits a photographing command to a first imaging unitaccording to the preset conditions in operation S1720. Therefore, thefirst imaging unit performs photographing a plurality of times andstores photographed images in a storage unit (not illustrated). If themulti display device is not in the automatic panorama mode, thecontroller 130 transmits a photographing command to the first imagingunit according to an input of a photographing command of a user inoperation S1730.

If the preset conditions are satisfied, the controller 130 ends thephotographing performed by the first imaging unit and determines whetherphotographing is to be performed by a second imaging unit in operationS1740. For example, the preset conditions may indicate that angles ofthe first and second imaging units are parallel with each other and arekept for 2 seconds.

In operation S1750, the controller 130 determines whether the multidisplay device is in the automatic panorama mode. Since the controller130 determines whether the multi display device is in the automaticpanorama mode in operation S1710, operation S1750 may be omitted. If themulti display device enters the automatic panorama mode, the controller130 transmits a photographing command to the second imaging unitaccording to a preset condition when a second display unit pivots, inoperation S1760. If the multi display device does not enter theautomatic panorama mode, the controller 130 transmits a photographingcommand to the second imaging unit according to an input of aphotographing command of the user in operation S1770. When operationS1750 is omitted, operation S1760 and operation S1770 may be selectivelyperformed according to the determination of the previous operationS1710. A detailed process of performing photographing of the secondimaging unit is the same as that of performing photographing of thefirst imaging unit.

FIG. 18 is a view illustrating a method of photographing a panoramaimage in a single photographing mode of a multi display device accordingto an exemplary embodiment of the present general inventive concept.

Referring to a view (1) of FIG. 18, first and second bodies 2 and 4 aredisposed to face opposite directions and overlap with each other.Photographing of a panorama image is performed when the first and secondbodies 2 and 4 are completely folded outwards (that is, display unitsand/or imaging units of the first and second bodies 2 and 4 are exposedto an outside of the first and second bodies 2 and 4), and the firstbody 2 including a first imaging unit pivots with respect to the secondbody 4. Before performing the photographing of the panorama image, auser may select a single or multi photographing mode. The singlephotographing mode indicates that the photographing for the panoramaimage is performed by using only the first imaging unit. The multiphotographing mode indicates that the photographing of the panoramaimage is performed by using both the first and second imaging units. Inother words, the multi photographing mode indicates that thephotographing of the panorama image is performed with sequentiallypivoting the first and second bodies 2 and 4.

A second display unit 190 b displays a menu 41 to select manual and/orautomatic panorama modes. If the manual panorama mode is selected, themulti display device 100 performs photographing according to aphotographing command of a user. If the automatic panorama mode isselected, the user may select a photographing frame. The selection ofthe photographing frame is to select how many images are to bephotographed until a photographing process is ended.

Only a photographing frame selection window is illustrated in a view (1)of FIG. 18, but other conditions may be set to perform the automaticpanorama mode. For example, the multi display device may recognize aface of a human to perform automatic photographing. In this case, themulti display device may simultaneously apply a predetermined anglecondition or a minimum overlapping area recognition condition and asubject particular portion recognition condition to perform theautomatic photographing.

Referring to a view (2) of FIG. 18, photographing is performed withpivoting the first body 2 in a left direction A with respect to thesecond body 4. The first body 2 may be manually pivoted by the user ormay be automatically pivoted by using a motor or a pivoting device (notillustrated) controlled by a controller. The second display unit 190 bof the second body 4 displays menus related to photographing on upperand lower ends. A curved semi-arc 75 and an image 77 photographed by thefirst imaging unit are displayed in a center of the second display unit190 b.

Referring to views (3) and (4) of FIG. 18, if the first imaging unitperforms photographing and then pivots in the left direction A toperform next photographing, the second display unit 190 b moves theimage 77, which has been previously photographed, to the right sidealong the curved semi-arc 75 to be displayed as an image 79, anddisplays an image 77 a, which is currently photographed, in the center.As another example, the second display unit 190 b may display the image77 a in the center and move and display the image 77 to the left side asthe image 79. Alternatively, the second display unit 190 b mayrespectively simultaneously move and display the image 77 a and theimage 77 to the right side and to the left side, respectively.

Referring to a view (5) of FIG. 18, if the first body 2 in which thefirst imaging unit is arranged forms a predetermined angle with thesecond body 2, photographing is ended.

As described above, if the first body 2 pivots in a first directionbased on a hinge unit with respect to the second body 4, a multi displaydevice displays a live view generated by a first imaging unit on asecond display unit and performs photographing by using the firstimaging unit. A controller controls the multi display device tophotograph images within a first photographing range and connect theimages photographed within the first photographing range to one anotherin order to generate a panorama image content. The capturing of theimages may be performed at a preset time or a time when a photographingcommand of a user is input. It is possible that the capturing of theimages may be performed at preset angles between the first body 2 andthe second body 4. It is also possible that the capturing of the imagesmay be performed at preset conditions or present relationships betweenimages according to a user or design preference. The photographed imagesmay be stored in a storage unit (not illustrated) of the multi displaydevice. The photographed images may be stored in an external storageunit in an exemplary embodiment. The multi display device maytemporarily store the photographed images in a random access memory(RAM) and then automatically delete the photographed images if acorresponding photographing mode is ended. Also, the multi displaydevice may output a message to ask the user about whether to delete thephotographed images and, if the user selects the deletion of thephotographed images, delete the photographed images. Alternatively, themulti display device may store the photographed images in a flashmemory, a hard disk, or the like automatically or according to a userselection.

FIG. 19 is a view illustrating a method of photographing a panoramaimage in a multi photographing mode according to an exemplary embodimentof the present general inventive concept.

Referring to a view (1) of FIG. 19, a first body 2 including a firstdisplay unit 190 a and a second body 4 including a second display unit190 b are disposed to face opposite directions and overlap with eachother. The second display unit 190 b displays a menu window 41′ toselect manual and/or automatic panorama modes. Referring to a view (2)of FIG. 19, as the first body 2 pivots to a left direction with respectto the second body 4, photographing is performed. Referring to views (3)and (4) of FIG. 19, if a first imaging unit of the first body 2 performsphotographing and then pivots to the left direction to perform nextphotographing, the second display unit 190 b moves an image 77′, whichhas been previously photographed, along a semi-arc 75′ to be displayedas an image 79′ and displays a next photographed image 77 a in a centerthereof. A detailed description thereof is as described with referenceto FIG. 18.

Referring to a view (5) of FIG. 19, if the first and second bodies 2 and4 are disposed to be parallel with each other, the photographing of thefirst imaging unit is ended, and photographing of the second imagingunit is performed. Alternatively, if the first and second bodies 2 and 4are disposed to be parallel with each other and are kept parallel witheach other for several seconds, the multi display device may set thesecond imaging unit to perform photographing.

In this case, a photographing screen displayed on the second displayunit 190 b is automatically switched over to the first display unit 190a. For example, if the first and second display units 190 a and 190 bare disposed to be parallel with each other and kept parallel with eachother for a predetermined time, the controller automatically switchesthe screen. As another example, when an angle between the first andsecond display units 190 a and 190 b exceeds 180°, the controller mayautomatically switch the screen.

Referring to a view (6) of FIG. 19, as the second body 4 pivots to aright direction with respect to the first body 2, photographing isperformed by the second imaging unit of the second body 4. A detaileddescription thereof is as described above. Referring to a view (7) ofFIG. 19, the second body 4 in which the second imaging unit is arrangedforms a predetermined angle with the first body 2, photographing isended. Alternatively, if the second body 4 is disposed to face anopposite direction to a direction that the first body 2 faces and tooverlap the first body 2, the photographing may be ended.

FIG. 20 is a flowchart illustrating a method of photographing a panoramaimage in a multi display device according to an exemplary embodiment ofthe present general inventive concept.

In operation S2010, a controller determines whether a multi displaydevice is in a photographing range setting mode. The controller displaysa photographing range setting screen on a display unit in thephotographing range setting mode. For example, a user may set one ormore photographing angles of first and second imaging units on thephotographing range setting screen. Alternatively, the user may set anoverlapping portion of the first and second imaging units to be aminimum. If a photographing range is set, the controller displays aphotographing angle adjusting guide in operation S2020. Thephotographing angle adjusting guide may display an angle to be formedbetween the first and second imaging units to perform photographing.Alternatively, if the angle between the first and second imaging unitsis formed so that an overlapping portion between the first and secondimaging units is minimum, the controller may inform the user of theangle by using a sound or an image. As another example, an anglemovement guide may be displayed to directly induce a photographing angleset by the user.

If adjusting of the angle is ended, photographing is performed accordingto an input of a photographing command of the user in operation S2030.If the photographing is performed, the controller combines two images togenerate a panorama image content in operation S2040.

FIG. 21 is a view illustrating a method of setting an angle of animaging unit to photograph a panorama image according to an exemplaryembodiment of the present general inventive concept.

Referring to FIG. 21, a first display unit 190 a displays aphotographing range setting screen 37. The photographing range settingscreen 37 may be displayed in a pop-up window form or may be displayedin a menu bar form in a predetermined space of the first display unit190 a. The photographing range setting screen 37 having the pop-upwindow form may be transparently or semi-transparently displayed. Thefirst display unit 190 a may display only the photographing rangesetting screen 37 or may display a screen photographed by a firstimaging unit and display the photographing range setting screen 37 onthe screen. For example, the photographing range setting screen 37 maydisplay several angles of the first imaging unit so that the userselects one of the several angles. As another example, an input windowmay be displayed so that the user inputs an angle with a number.Alternatively, the photographing range setting screen 37 may include alist of minimum overlapping area angles.

A second display unit 190 b displays a live view screen generated by animaging unit. The second display unit 190 b may display only a screenphotographed by a second imaging unit as an entire screen or may dividethe screen into two areas to respectively display screens 71 and 73photographed by the first and second imaging units in the two areas.

FIG. 22 is a view illustrating a method of using an angle guide tophotograph a panorama image according to an exemplary embodiment of thepresent general inventive concept.

Referring to FIG. 22, a first display unit 190 a displays an angle guide39 having a text form to induce a photographing angle set by a user.

The angle guide 39 may directly display directions and degrees ofmovements of imaging units to the user and display angles changingaccording to changes of angles of the imaging units. Alternatively, theangle guide 39 may display an image at an angle at which the imagingunit performs photographing, on the first display unit 190 a. Accordingto the method of displaying the image at the angle at which thephotographing is performed, if the imaging unit photographs a leftportion of a subject, an image leaning to (disposed at) a left area of adisplay unit may be displayed. If the imaging unit photographs a rightportion, an image leaning to (disposed at) a right area of the displayunit may be displayed. If an angle of the imaging unit becomes an angleset on a photographing range setting screen or a minimum overlappingarea angle, the user is informed of the angle by using an image or asound. As another example, if the angle of the imaging unit becomes anangle set by the user, the imaging unit may automatically performphotographing.

A second display unit 190 b may display the same screen as thatdescribed with reference to FIG. 21. The screens displayed on the firstand second display units 190 a and 190 b of FIGS. 21 and 22 may bedisplayed on opposite display units.

As described in the method above, the multi display device photographs aplurality of images in a horizontal direction. However, the multidisplay device may photograph the plurality of images in a verticaldirection. The controller connects the plurality of images photographedby the above-described method to one another in a horizontal or verticaldirection to generate one panorama image content. The panorama imagecontent generated by the above-described method may have various formsand thus requires editing such as cropping.

FIG. 23 is a view illustrating a method of generating a cropped imageaccording to an exemplary embodiment of the present general inventiveconcept.

Referring to a view (1) of FIG. 23, a display unit combines a pluralityof images to generate one panorama image. The panorama image refers toone continuous image that is generated by connecting overlappingportions of images to one another. Since compositions of images of aninitially generated panorama image 22 do not accurately match with oneanother, the initially generated panorama image 22 may have variousforms. If the initially generated panorama image 22 is selected, thecontroller may enlarge the selected image to display the initiallygenerated panorama image 22 to an entire screen of first and seconddisplay units.

Referring to a view (2) of FIG. 23, the display unit displays a menuwhich is to select whether the initially generated panorama image 22 isto be cropped. Since the initially generated panorama image 22 has thevarious forms as described above, a predetermined rectangular shape maybe cropped from the initially generated panorama image 22. If anautomatic crop 43 is selected, the display unit displays a progress bar13 indicating a progress state of generating a cropped image. Thecropped image may be stored, and enlarged and displayed on the displayunit.

FIG. 24 is a view illustrating a single mode according to a hinge unitangle of a multi display device according to an exemplary embodiment ofthe present general inventive concept. The multi display device of FIG.24 may be described with reference to the multi display device 100 ofFIGS. 1-9.

Referring to FIG. 24, the multi display device 100 includes first andsecond bodies 2 and 4. The first and second bodies 2 and 4 are connectedto each other through a hinge unit 185 to perform relative movements.The first and second bodies 2 and 4 may be electrically connected toeach other. A first display unit 190 a is arranged on a side of thefirst body 2, and at least one physical button is arranged on a side ofthe first display unit 190 a.

If the first and second bodies 2 and 4 are connected to each otherthrough the hinge unit 185 to pivot, the multi display device 100 may bea portable phone, a notebook PC, a tablet PC, a portable multimediaplayer (PMP), or the like. In the above description, the first displayunit 190 a and a second display unit 190 b are respectively arranged onthe first and second bodies 2 and 4. However, as will be describedlater, a touch screen display may be provided on one of two panels.Also, at least one of functional buttons provided on a side of each ofthe first and second display units 190 a and 190 b may be omitted. Inaddition, as described above, the first and second bodies 2 and 4 areconnected to each other through the hinge unit 185. However, if thefirst and second bodies 2 and 4 are folded through relative movements,the first and second bodies 2 and 4 may be connected to each otherthrough another element.

The hinge unit 185 may include two hinges that are arranged at upper andlower connection parts between the first and second bodies 2 and 4. Atleast one of the first and second bodies 2 and 4 may have a portiondisposed between the two hinges of the hinge unit 185 to support the twohinges. The hinge unit 185 may include one hinge that is arranged at allconnection parts between the first and second bodies 2 and 4.

The multi display device 100 may include a display device including thefirst and second display units 190 a and 190 b that are physically or agraphically separated from each other and may support various screenmodes by using the first and second display units 190 a and 190 b. Thefirst and second display units 190 a and 190 b may have a screen area. Aportion of the screen area may be disposed in the portion of the firstand second bodies 2 and 4 between the two hinges.

Various modes may be used according to a relative angle θ between thefirst and second bodies 2 and 4 of the multi display device 100. Therelative angle θ refers to a pivoting angle between the first and secondbodies 2 and 4 such that the first and second bodies 2 and 4 pivot in apredetermined direction (for example, in a counterclockwise direction).In detail, the relative angle θ may be detected by a hinge sensor (notillustrated) installed in the hinge unit 185. The hinge sensor includesone of a hole sensor (hall sensor), a pressure sensor, an inductiondetection sensor, an electrical contact sensor, and an optical sensor todetect a motion and a relative position of the hinge in order torecognize the relative angle θ.

The relative angle θ may be recognized by detecting positions of thefirst and second bodies 2 and 4 through a geomagnetic sensor or anacceleration sensor besides the hinge sensor.

As illustrated in FIG. 24, when the first and second display units 190 aand 190 b on the first and second bodies 2 and 4 are disposed oppositeto each other, the first and second bodies 2 and 4 are disposed at aposition to contact each other. In other words, the second display unit190 is positioned on a side opposite to a side on which the firstdisplay unit 190 a is positioned. When the user sees the first displayunit 190 a, the second display unit 190 b is positioned on an oppositeside, and thus the user may not directly see the second display unit 190b. The user may see only one display unit as described above.

Here, the relative angle θ may be 0° as illustrated in FIG. 24. Forexample, if the relative angle θ between the first and second bodies 2and 4 is between 0° and 60°, the relative angle θ may be referred to asa single mode. The single mode may be usefully used when the multidisplay device 100 is locked and in a call application. In the singlemode, the first display unit 190 a arranged on a front side may displaya job screen generated by at least one application, and the seconddisplay unit 190 b on a back side may be turned off. A few ofapplications may turn on the second display unit 190 b arranged on theback side by using an option menu. The user may see only one displayscreen in the single mode, and thus the controller 130 controls only onedisplay unit. In other words, the controller 130 transmits a controlsignal only to a display unit that the user currently sees. Thecontroller 130 may not transmit an additional control signal and anadditional data signal to a display unit that is not controlled by thecontroller 130, thereby reducing power consumption.

Here, the display unit that does not receive the control signal and thedata signal operates in a sleep mode. Also, if the controller 130applies a signal to change the sleep mode to another mode to the displayunit or the user pivots a direction of the multi display device 100 tosee the display unit operating in the sleep mode, the sleep mode of thedisplay unit is changed to another mode.

FIG. 25 is a view illustrating an expanding mode of a multi displaydevice according to an exemplary embodiment of the present generalinventive concept.

Referring to FIG. 25, first and second bodies 2 and 4 are disposed at aposition to be parallel with each other, and a relative angle θ is 180°or is approximate to 180° within a predetermined range. In other words,the first and second bodies 2 and 4 are unfolded. Hereinafter, this isreferred to as an expanding mode. For example, when the relative angle θbetween the first and second bodies 2 and 4 is within a range between175° and 185°, the multi display device 100 recognizes the first andsecond bodies 2 and 4 as being unfolded. In the expanding mode, two jobscreens for two applications may be respectively displayed on first andsecond display units 190 a and 190 b, one job screen for one applicationmay be displayed on the first and second display units 190 a and 190 b,or two job screens for one application may be displayed on the first andsecond display units 190 a and 190 b. Any application may not bedisplayed on one display unit but a defaulted home screen may bedisplayed on the one display unit. The expanding mode may be usefullyused on an E-book, a moving picture application, and a web browsingscreen. The expanding mode may also be usefully used for several typesof photographing using the imaging unit 140.

As described above, the controller 130 may control a photographingprocess to generate a 3D image content by simultaneously using first andsecond imaging units and a photographing process to generate a panoramaimage content.

If one imaging unit is activated, the first and second display units 190a and 190 b may display an image photographed by the activated imagingunit. A method of displaying a photographed image on a display unit willnow be described.

FIGS. 26 through 28 are views illustrating a photographing screen of animaging unit in an expanding mode in a multi display device according toan exemplary embodiment of the present general inventive concept.

Referring to FIG. 26, a selection menu bar 511 is displayed on an upperend area of the first display unit 190 a. The selection menu bar 511 mayinclude an imaging unit selection button, a photographing mode selectionmode, etc. The imaging unit selection button may separately turn onand/or off imaging units installed in a multi display device. An albumarea 513 is displayed on a lower end area of the first display unit 190a. The album area 513 displays a list of the predetermined number ofphotos that have been recently photographed or stored.

A quick dock bar 521 is displayed on an upper end area of the seconddisplay unit 190 b. The quick dock bar 521 is an area that quicklyexecutes a shortcut function of a tool set of an image unit. A user maydirectly activate the tool set to add a desired function to the quickdock bar 521. A control bar 523 is displayed on a lower end area of thesecond display unit 190 b. The control bar 523 may include aphotographing button 524, a photo and/moving picture mode change button,etc. An auxiliary photographing button 525 is displayed in a rightcenter area of the second display unit 190 b. The auxiliaryphotographing button 525 is an auxiliary button that executes aphotographing function and may be activated by using a proximity sensorwhen a user object or a pen having a predetermined condition approachesthe auxiliary photographing button 525. The photographing button 524 andthe auxiliary photographing button 525 may correspond to the first andsecond imaging units, respectively.

If two imaging units are activated, a display unit may be divided intotwo areas. According to an exemplary embodiment for dividing the displayunit into the two areas, an image photographed by a first imaging unitmay be displayed on a first display unit, and an image photographed by asecond imaging unit may be displayed on a second display unit. Asanother exemplary embodiment, as illustrated in FIG. 26, the first andsecond display units 190 a and 190 b may be regarded as a whole screento be divided into upper and lower screens 90 and 91. A boundary 52between the upper and lower screens 90 and 91 may be moved by using atouch gesture, a space gesture, or the like.

Referring to FIG. 27, three imaging units are activated in the multidisplay device. Menu screens displayed on the first and second displayunits 190 a and 190 b are as described with reference to FIG. 26. Adisplay unit may be divided into three areas to display imagesphotographed by the three imaging units that have been activated.According to an exemplary embodiment, as illustrated in FIG. 27, thefirst and second display units 190 a and 190 b may be regarded as awhole screen to be divided into three screens 93, 94, and 95 in avertical direction. Boundaries 54 and 55 between the three screens 93,94, and 95 may be moved by using a touch gesture, a space gesture, orthe like. Areas of the screens 93, 94, and 95 may be variable accordingto movements of the boundaries 54 and 55. According to another exemplaryembodiment, the three screens 93, 94, and 95 may be vertically equallydivided.

According to another exemplary embodiment, referring to FIG. 28, threeimaging units are activated to divide a screen.

A display unit is divided into three areas to display imagesphotographed by the three imaging units that have been activated. Animage photographed by a first imaging unit is displayed as a firstpicture-in-picture (PIP) 98 on a lower end of a first display unit. Animage photographed by a second imaging unit is displayed as a second PIP99 on a lower end of a second display unit. An image photographed by athird imaging unit is displayed as a whole screen 97 of the first andsecond display units. In this case, the image displayed as the wholescreen 97 is displayed as a main PIP image including portions tocorrespond to the first and second PIPs 98 and 99. Positions and sizesof the first and second PIPs 98 and 99 may be variously adjusted, anddisplays of the images photographed by the first through third imagingunits are not limited to the above-described areas.

In FIGS. 26 through 28, divided screens displayed on two display unitshave been described. However, the above-described method may be appliedto one display unit. In other words, the one display unit may behorizontally or vertically divided into two or three areas, andboundaries between the divided areas may be moved. Alternatively, imagesmay be displayed as a whole screen and PIPs on one display unit.

FIG. 29 is a view illustrating a method of selecting a screen frame in amulti display device according to an exemplary embodiment of the presentgeneral inventive concept.

Referring to a view (1) of FIG. 29, images are displayed in first andsecond display units 190 a and 190 b and a PIP area 190 b′ of the seconddisplay unit 190 b. A screen frame selection button 531 is displayed onan upper end area of the second display unit 190 b. A user taps thescreen frame selection button 531.

Referring to a view (2) of FIG. 29, a frame selection menu 533 isdisplayed as a pop-up window form on the second display unit 190 baccording to the selection of the screen frame selection button 531 ofthe view (1) of FIG. 29. The frame selection menu 533 may be variouslydisplayed according to the number of imaging units that are activated.For example, if two imaging units are activated, the first and seconddisplay units 190 a and 190 b may display respectively photographedimages by each imaging unit, and a whole part of the first and seconddisplay units 190 a and 190 b may be horizontally divided into two areasand display respectively photographed images by each imaging unit. Inthe view (2) of FIG. 29, since three imaging units are activated, theframe selection menu 533 displays a menu to horizontally divide thefirst display unit 190 a and to display a whole part of the seconddisplay unit 190 b, a menu to display a whole part of the first displayunit 190 a and to horizontally divide the second display unit 190 b, amenu to divide the first and second display units 190 a and 190 b intothree areas, and a menu to vertically divide the first and seconddisplay units 190 a and 190 b into three areas.

If one imaging unit is used, a screen dividing function may not beperformed. Therefore, in this case, if the screen frame selection button531 or the frame selection menu 533 is selected, the controller 130displays a message indicating that the frame selection menu 533 may notbe used.

Referring to a view (3) of FIG. 29, a selection of horizontally dividingthe first display unit 190 a into two areas and wholly displaying thesecond display unit 190 b is made. Therefore, screens are divided as theselection is made, to display images. A boundary may be moved asdescribed with reference to FIG. 26.

Since the multi display device includes a plurality of imaging units anda plurality of display units, various types of images may be acquired byusing the plurality of imaging units and the plurality of display unitsaccording to various methods. In other words, functions are separatelyset with respect to the plurality of imaging units and the plurality ofdisplay units to apply different functions with respect to the samesubject in order to perform photographing and displaying.

For example, a function of photographing a still image may be set withrespect to the first imaging unit, and a function of photographing amoving picture may be set with respect to the second imaging unit.Alternatively, a general image photographing function may be set withrespect to the first imaging unit, and a special effect photographingfunction may be set with respect to the second imaging unit. Functionsmay be separately set with respect to the corresponding display units.For example, a moving picture display function may be set with respectto the first display unit 190 a, and a still image display function maybe set with respect to the second display unit.

The user may set these separate functions through a setting screen. Inother words, if the user selects a menu button, the multi display devicedisplays the setting screen on at least one of the first and seconddisplay units 190 a and 190 b. Functions that may be applied to theimaging units and the display units may be displayed on the settingscreen. The user may respectively set and store desired functions withrespect to the imaging units or the display units in a memory unit byusing the setting screen. The controller 130 of the multi display devicestores contents set through the setting screen and uses the storedcontents in subsequent operations.

Various methods and operations of setting and using different functionswith respect to imaging units or display units as in the presentexemplary embodiment will now be described.

FIGS. 30 and 31 are views illustrating operations of a multi displaydevice according to an exemplary embodiment of the present generalinventive concept.

FIG. 30 illustrates the multi display device that executes a still imagephotographing mode and a moving picture photographing mode. Referring toa view (1) of FIG. 30, a first imaging unit is set to the still imagephotographing mode, and a second imaging unit is set to the movingpicture photographing mode. An image photographed by the first imagingunit is displayed on a first display unit 190 a, and an imagephotographed by the second imaging unit is displayed on a second displayunit 190 b. Therefore, a photographing button 541 is displayed on alower end area of the first display unit 190 a, and a moving picturephotographing button 543 is displayed on a lower end area of the seconddisplay unit 190 b. A moving picture photographing progress time 15 a isdisplayed on an upper end area of the second display unit 190 b toindicate a time taken for photographing and/or recording.

Referring to a view (2) of FIG. 30, a bird and a tree are photographedas subjects. If the bird sits on the tree, the first imaging unitphotographs a still image, and the second imaging unit photographs amoving picture. If the bird flies from the tree after 14 seconds passes,the first display unit 190 a displays an image in which the bird sits onthe tree, and the second display unit 190 b displays a progress time 15b to indicate that a moving picture is being photographed for 14 secondsand an image which the bird flies from the tree.

FIG. 31 illustrates the multi display device that executes a sceneryphotographing function and a person photographing function. Referring toa view (1) of FIG. 31, the scenery photographing function is set withrespect to a first imaging unit, and the person photographing functionis set with respect to a second imaging unit. If the sceneryphotographing function is set, the controller 130 zooms the firstimaging unit out to photograph a whole scenery. If the personphotographing function is set, the controller 130 zooms the secondimaging unit in to photograph a person on a whole screen. An imagephotographed by the first imaging unit is displayed on the first displayunit 190 a, and an image photographed by the second imaging unit isdisplayed on the second display unit 190 b. Therefore, if a user tapsphotographing buttons 545 and 547 displayed on lower end areas of thefirst and second display units 190 a and 190 b, the first display unit190 a displays a photographed scenery image, and the second display unit190 b displays a photographed person image. Alternatively, the user maytap one of the photographing buttons 545 and 547 to simultaneously storethe scenery image and the person image in a memory unit.

The functions illustrated in FIGS. 30 and 31 are an exemplaryembodiment, and thus various modifications, such as specific effectphotographing, continuous photographing, shutter first photographing,iris first photographing, etc., may be made.

As described above, the exemplary embodiment to separately set functionswith respect to imaging units and display units may be realized througha combination of an exemplary embodiment for the above-describedpanorama photographing and an exemplary embodiment for 3D photographing.

For example, in a multi display device executing panorama photographing,a controller may display a setting screen for respectively settingfunctions with respect to first and second display units on at least oneof the first and second display units. The user may select thefunctions, which are to be respectively applied to the first and seconddisplay units, by using the setting screen. The controller separatelycontrols display operations of the first and second display unitsaccording to a function selected on the setting screen.

For example, if a panorama display function is set with respect to thefirst display unit, and a mono display function is set with respect tothe second display unit, the controller may display a panorama imagecontent on the first display unit and display one of separate imagecontents respectively photographed by the first and second imagingunits. Alternatively, a screen of the second display unit may be dividedto all of images photographed by the first and second imaging units. Theuser may touch and drag a screen on the first display unit that displaysthe panorama image content to move the panorama image content in orderto check a whole part of the panorama image content. Also, the user maytouch and flick a screen on the second display unit to change separateimage contents in order to check the separate image contents one by one.

Besides the panorama display function or the mono display function,various special effects, such as a black and white display function, anegative display function, a sepia function, zoom-in/zoom-out functions,etc., may be separately set with respect to display units.

Alternatively, different functions may be separately set with respect toimaging units. For example, a panorama photographing function may be setwith respect to the first imaging unit, and a still image photographingfunction or a moving picture photographing function may be set withrespect to the second imaging unit to separately acquire images. Thepresent exemplary embodiment may also be realized in an exemplaryembodiment for 3D photographing. The controller displays a settingscreen for respectively setting functions of the first and seconddisplay units on at least one of the first and second display units. Thecontroller may separately control display operations of the first andsecond display units according to a function selected on the settingscreen. According to a detailed exemplary embodiment, the controllerperforms a 3D display function with respect to the first display unitand a 2D display function with respect to the second display unitaccording to an input of the user. A 3D image content may be displayedon the first display unit, and at least one of left and right eye imagesmay be displayed on the second display unit.

FIG. 32 is a view illustrating a tool kit mode of a multi display deviceaccording to an exemplary embodiment of the present general inventiveconcept.

A structure of a first body 2 is as described with reference to FIG. 24.A second display unit 190 b is arranged on a side of a second body 4,and at least one physical button is arranged on a side of the seconddisplay unit 190 b. The physical button includes at least one of a pushbutton and a touch button. According to an exemplary embodiment, a firstdisplay unit 190 a may be arranged on the first body 2 including aspeaker 163 and a microphone 162 and operate as a main screen. Thespeaker 163 and the microphone 162 may correspond to at least one of thefirst body 2 and the second body 4 according to a user or designpreference/selection. Although FIG. 32 illustrates the speaker 163 andthe microphone 162 disposed on the same side of the first body 2 as thefirst display unit 190 a, the speaker 163 and the microphone 162 may bedisposed on a different side of the first body. It is also possible thatthe speaker 163 and the microphone 162 may be formed as a single unit.It is also possible that the speaker 163 and/or the microphone 162 aredisposed on the second body 4. The second display unit 190 b arranged onthe second body 4 may operate as a sub screen. According to an exemplaryembodiment, the first body 2 includes a first imaging unit 141, and thesecond body 4 includes a second imaging unit 142.

As illustrated in FIG. 32, a relative angle between the first and secondbodies 2 and 4 exceeds 180°, i.e., the first and second display units190 a and 190 b are slightly folded inwards. In the presentspecification, this state is referred to as a tool kit mode. As anexample, the relative angle between the first and second bodies 2 and 4is within a range, for example, between 185° and 265°, this state isrecognized as the tool kit mode. The tool kit mode is useful when thefirst and second display units 190 a and 190 b are folded inward, andthus the multi display device 100 is used as a similar form to anotebook PC. As an example, a job screen is displayed on one of thefirst and second display units 190 a and 190 b, and various jobenvironments are displayed on the second display unit 190 b to display atool such as a keyboard, etc.

FIGS. 33 through 35 are views illustrating a screen frame in a tool kitmode of a multi display device according to an exemplary embodiment ofthe present general inventive concept.

Referring to a view (1) of FIG. 33, a second display unit 190 b displaysa home screen. Several types of menus and information and an imagingunit selection button are displayed on the home screen. If a user tapsthe imaging unit selection button, one imaging unit is activated. Afirst display unit 190 a displays various types of menus or toolsrelated to other functions, such as a menu, an icon, a keyboard, etc.

Referring to a view (2) of FIG. 33, the second display unit 190 bactivates one imaging unit to display a photographing screen of the oneimaging unit. A quick dock bar 551 and a selection menu area 553 havinga vertical shape are displayed on a left side of the second display unit190 b as illustrated in the view (2) of FIG. 33. A control bar and analbum area 555 are displayed on a right side of the second display unit190 b. The user activates a second imaging unit using a selectionbutton.

Referring to a view (3) of FIG. 33, at least a portion of the seconddisplay unit 190 b is divided into two areas to display photographingscreens of two imaging units. The areas may be arranged in a verticaldirection or in a horizontal direction. In this case, a background of aselection menu area 553 a is displayed as a blank to maintain aresolution. The user taps a frame selection button.

Referring to a view (4) of FIG. 33, the second display unit 190 bdisplays a frame selection menu 557 in a pop-up window form according tothe frame selection button. A photographing screen of an imaging unit isused only on the second display unit 190 b, and thus only a frame havinga vertical division form is selected. The user selects the frame havingthe vertical division form.

Referring to a view (1) of FIG. 34, the second display unit 190 bdisplays a screen that is vertically divided into a plurality of areas,for example, like a plurality of vertical column shapes. A user expandsa screen displayed on the second display unit 190 b onto the firstdisplay unit 190 a by using a gesture or the like with respect to thesecond display unit 190 b.

Referring to a view (2) of FIG. 34, the screen expanded from the seconddisplay unit onto the first display unit 190 a is displayed. In thiscase, a selection menu area 553 illustrated in the view (1) of FIG. 34is also moved onto the first display unit 190 a to be constituted as aselection menu area 553 b on a left side of the first display unit 190a. The album area 555 displayed on the control bar shown in the view (2)of FIG. 33 is also moved onto the first display unit 190 a to beconstituted as an album area 561 on a right side of the first displayunit 190 a. The user taps the frame selection button.

Referring to a view (3) of FIG. 34, the second display unit 190 bdisplays a frame selection menu 557 a in a pop-up window form accordingto the frame selection button. The frame selection menu 557 a displays acurrently available frame. The user selects a displayed frame having ahorizontal division form.

Referring to a view (4) of FIG. 34, the first and second display units190 a and 190 b respectively display photographing screens of twoimaging units according to the selected frame.

Referring to a view (1) of FIG. 35, a selection menu area 553 b of thefirst display unit 190 a displays an activated imaging unit and aninactivated imaging unit. The user may tap a selection button for theinactivated imaging unit.

Referring to a view (2) of FIG. 35, the first display unit 190 a isvertically divided to display photographing screens 574 and 576 of twoimaging units, and the second display unit 190 b displays aphotographing screen 572 of one imaging unit. The user inputs a commandto change an area of the first display unit 190 a.

Referring to a view (3) of FIG. 35, a size of a display area of thefirst display unit 190 a is changed according to an input of the user.The user taps a photographing button of a control bar 555. The user mayselect an image or an area to be photographed before photographing isperformed.

Referring to a view (4) of FIG. 35, a photographed image is added as alist 578 of album areas. The photographed image may be one of images ofthe activated imaging unit, an image displayed on one of the first andsecond display units 190 a and 190 b, or an image displayed on a wholepart of the first and second display units 190 a and 190 b.

FIG. 36 is a view illustrating a video call function of a multi displaydevice according to an exemplary embodiment of the present generalinventive concept. The multi display device 100 may be used as the multidisplay device of FIG. 36.

Referring to FIG. 36, the multi display device 100 includes first,second, and third imaging units 141, 142, and 146′. The first displayunit 190 a displays a subject image 593 photographed by the thirdimaging unit 146′ on a whole screen. The first display unit 190 adisplays a user image 595 photographed by the first or second imagingunit 141 or 142. At least one of the subject image 593 and the userimage 595 displayed on the first display unit 190 a may be transmittedto an external counterparty of a video call through an interface (notillustrated) of the multi display device 100. The second display unit190 b displays on a screen (or full screen) an image 594 correspondingto an external counterparty of a video call received through aninterface (not illustrated) of the multi display device 100. Areasdisplaying images or sizes of the displayed images may be adjustedaccording to a user or design selection/preference.

According to an exemplary embodiment, one imaging unit may be arrangedon the same side of the first or second body as a display unit, and twoimaging units may be displayed on an opposite side to the display unitwith respect to a housing of the corresponding body. In this case, theone imaging unit arranged on the same side as the display unit mayphotograph a user, and the two imaging units arranged on the oppositeside to the display unit may photograph a subject. A panorama imagecontent or a 3D image content may be generated by using two imagesacquired by photographing the subject. The panorama image content or the3D image content including an image acquired by photographing the usermay be displayed on a display unit. Also, at least one of the imageacquired by photographing the user, a generated panorama image, and a 3Dimage may be transmitted to the external counterparty.

FIG. 37 is a view illustrating a video call function of a multi displaydevice including rotary imaging units according to an exemplaryembodiment of the present general inventive concept. The multi displaydevice 100 may be used as the multi display device of FIG. 37.

Referring to FIG. 37, the multi display device 100 includes first andsecond rotary imaging units 148 and 149. The first display unit 190 adisplays a subject image 597 photographed by the second rotary imagingunit 149 on a full screen. The first display unit 190 a also displays auser image 599 photographed by the first rotary imaging unit 148 as aPIP. At least one of the subject image 597 and the user image 599displayed on the first display unit 190 a may be transmitted to acounterpart of a video call. The second display unit 190 b displays acounterpart 598 of the video call on a full screen. The first and secondrotary imaging units 148 and 149 are rotatable and thus freely selectsubjects to be photographed. Areas display images or sizes of the imagesmay be freely adjusted.

FIG. 38 is a view illustrating a standing mode of a multi display deviceaccording to an exemplary embodiment of the present general inventiveconcept.

Referring to FIG. 38, a relative angle between first and second bodies 2and 4 is smaller than 180°, i.e., first and second display units 190 aand 190 b are folded outwards and disposed to respectively face nearlyopposite directions. In the present specification, this state isreferred to as a standing mode. As an example, the relative anglebetween the first and second bodies 2 and 3 is within a range between30° and 90°, the multi display device 100 recognizes the standing mode.In the standing mode, the first and second display units 190 a and 190 bare folded outwards, and thus the multi display device 100 stands in atriangle shape on a floor or a reference plane. Therefore, the standingmode may be useful when charging is performed, when the multi displaydevice 10 is used as a digital clock or frame, or when a personalbroadcast, a movie, a moving picture, or the like is displayed andviewed for a long period of time.

According to an exemplary embodiment, the standing mode may be appliedto an application requiring a cooperation or interaction between two ormore users, for example, a video conference, a collaborative game, orthe like. The first display unit 190 a arranged on a front side of themulti display device may display a job screen according to one or moreapplications and the second display unit 190 b arranged on a back sidemay be turned off. A few of applications may turn on the second displayunit 190 b arranged on the back side by using an option menu.

FIGS. 39 and 40 are views illustrating a screen frame in a standing modeof a multi display device according to an exemplary embodiment of thepresent general inventive concept.

Referring to a view (1) of FIG. 39, a first display unit 190 a displaysa home screen. The home screen displays several types of menus andinformation and an imaging unit selection button. If a user taps theimaging unit selection button, one imaging unit is activated.

Referring to a view (2) of FIG. 39, a controller of the multi displaydevice may activate one imaging unit according to a selection of a menuof the first display unit 190 a to display a photographing screen of theimaging unit. In general, the user watches a screen displayed on thefirst display unit 190 a. Therefore, the controller may activate asecond imaging unit arranged on the same side as a second display unit190 b to display a photographing screen of the second imaging unit onthe first display unit 190 a. A quick dock bar 583 having a verticalshape and a selection menu area 585 are displayed on a left side of thefirst display unit 190 a. A control bar having a vertical shape and analbum area may be displayed on a right side of the first display unit190 a. The album area may be displayed in the same area as the controlbar and may display only one or two lists. The user taps a photographingbutton.

Referring to a view (3) of FIG. 39, a photographed image is added as alist of album areas. The user taps a frame selection button 587.

Referring to a view (4) of FIG. 39, since the multi display deviceactivates only one imaging unit, a screen division function may not beused. Therefore, the controller displays information indicating that thescreen division function may not be used, in a pop-up window form 589.

Referring to a view (1) of FIG. 40, a selection menu area is displayedon a left side of a first display unit 190 a. The selection menu area isdisplayed over a photographing screen of an imaging unit displayed onthe first display unit 190 a. A user taps a first imaging button of theselection menu area to activate a first imaging unit that has beeninactivated.

In the view (1) of FIG. 40, the first display unit 190 a displays thephotographing screen of the first imaging unit as a PIP 591 a accordingto an input to activate the first imaging unit. Therefore, a full screenof the first display unit 190 a displays a photographing screen of asecond imaging unit, and the PIP 591 a displays the photographing screenof the first imaging unit.

Referring to a view (2) of FIG. 40, a screen is displayed on a seconddisplay unit 190 b. A full screen of the second display unit 190 bdisplays the photographing screen of the first imaging unit, and a PIP591 b displays the photographing screen of the second imaging unit. Aselection menu area, a quick dock, or a control bar may be displayed onthe second display unit 190 b.

FIG. 41 is a view illustrating a standing mode of a multi display deviceaccording to another exemplary embodiment of the present generalinventive concept. The multi display device 100 may be used as the multidisplay device.

Referring to FIG. 41, the multi display device 100 is disposed to standon a floor (reference plane) such that a portion of a hinge contacts thefloor. In the present specification, this state is referred to aportrait mode. In the portrait mode, a relative angle between first andsecond bodies 2 and 4 is within a range between 30° and 90°, and themulti display device 100 is vertically erected by an accelerationsensor.

In detail, the acceleration sensor senses a rotation of the multidisplay device 100. The acceleration sensor senses a change between theportrait mode in which the first and second display units 190 a and 190b of the multi display device 100 are respectively arranged on left andright sides and a landscape mode in which the first and second displayunits 190 a and 190 b are arranged on upper and lower sides.

The portrait mode may be applied to an application that providesdifferent images to two or more users, for example, to a videoconference, a multi video player, or the like.

FIG. 42 is a detailed block diagram illustrating a multi display device100 according to an exemplary embodiment of the present generalinventive concept.

The multi display device 100 may be connected to an external device (notillustrated) by using a communicator having at least one of a cellularcommunication module 111, a wireless local area network (WLAN) module112, a near field communication (NFC) module 113, a connector 114. Theexternal device may include at least one of another device, a portablephone, a smart phone, a tablet personal computer (PC), a computerserver, and a digital TV.

Referring to FIG. 42, the multi display device 100 includes first andsecond display units 190 a and 190 b. Although FIG. 42 illustrates twodisplay units, the present general inventive concept is not limitedthereto. The multi display device 100 may have three or more displayunits.

The multi display device 100 according to the present general inventiveconcept includes the communicator 110, a multimedia unit 120, acontroller 130, an imaging unit 140, a sensor unit 150, an input/outputunit 160, a storage unit 170, a power supply unit 180, and first andsecond display units 190 a and 190 b.

The communicator 110 may be an interface to communicate with theexternal device and may include the cellular communication module 111,the WLAN module 112, the NFC module 113, the connector 114, a globalpositioning system (GPS) module 115, and a broadcasting communicationmodule 116.

The cellular communication module 111 is controlled by the controller130 to connect the multi display device 100 to the external device (inparticular, a base station of a cellular system) through at least oneantenna or a plurality of antennas (not illustrated) by using a wirelessaccess technology complying with a cellular communication protocol.

The cellular communication module 111 transmits and/or receives awireless signal including a voice call, a video call, a short messagingservice (SMS) message, or a multimedia messaging service (MMS) messagewith another communicable device such as a portable phone, a smartphone, a tablet PC, or another type of device having a phone numberinput into the multi display device 100

The communicator 110 may include at least one of the WLAN module 112 andthe NFC module 113. For example, the communicator 110 may include onlythe WLAN module 112, only the NFC module 113, or both of the WLAN module112 and the NFC module 113.

The WLAN module 112 is controlled by the controller 130 to be connectedto the Internet in a place in which a wireless access point (AP) isinstalled. The WLAN module 112 supports WLAN standard IEEE 802.11x ofInstitute of Electrical and Electronics Engineers (IEEE).

The NFC module 113 is controlled by the controller 130 to wirelesslyperform an NFC between the multi display device 100 and the externaldevice. An NFC method may include a Bluetooth communication, an infrareddata association (IrDA) communication, etc.

The connector 114 provides interfaces, such as USB 2.0, USB 3.0, HDMI,IEEE 1394, etc., with various types of devices such

The connector 114 may be used as an interface which is to connect themulti display device 100 to the external device or a power source. Undercontrol of the controller 130, the connector 114 transmits data storedin the storage unit 170 of the multi display device 100 to the externaldevice through a cable connected to the connector 114 or receives datafrom the external device. Power may be input from a power source (notillustrated) through the cable connected to the connector 114 or abattery (not illustrated) may be charged through the cable

The GPS module 115 receives electromagnetic waves from a plurality ofGPS satellites (not illustrated) and calculates a position of the multidisplay device 100 by using times of arrivals from the GPS satellites tothe multi display device 100 and GPS parameters.

Under control of the controller 130, the broadcasting communicationmodule 116 receives a broadcast signal (for example, a TV broadcastsignal, a radio broadcast signal, or a data broadcast signal) andadditional broadcast information (for example, an electric program guide(EPS) or an electric service guide (ESG)) from a broadcasting stationthrough a broadcasting communication antenna (not shown).

The multimedia unit 120 includes an audio play module 121 and a videoplay module 122.

The audio play module 121 plays a digital audio file (for example, afile having file extension “mp3”, “wma”, “ogg”, or “wav”) stored orreceived under control of the controller 130. The video play module 122supports various types of codecs to play the digital video file. Inother words, the video play module 122 plays the digital video file by astored codec according to a codec form of a video file to be played. Theaudio play module 121 or the video play module 122 of the multimediaunit 120 may be included in the controller 130.

The controller 130 includes a central processing unit (CPU), a read onlymemory (ROM) that stores a control program to control the multi displaydevice 100, and a random access memory (RAM) that stores a signal ordata input from an outside of the multi display device 100 or is used asa memory space for a job executed in the multi display device 100. TheCPU may include at least one of a single core processor, a dual coreprocessor, a triple core processor, and a quad core processor. The CPU,the ROM, and the RAM are connected to one another through an internalbus.

The controller 130 controls the communicator 110, the multimedia unit120, the imaging unit 140, the sensor unit 150, the input/output unit160, the storage unit 170, the power supply unit 180, and the first andsecond display units 190 a and 190 b.

The imaging unit 140 includes at least one of first and second imagingunits 141 and 142. Although FIG. 42 illustrates the first and secondimaging units 141 and 142, the present general inventive concept is notlimited thereto. It is possible that the imaging unit 140 may furtherinclude an additional imaging unit according to an exemplary embodiment.

The imaging unit 140 may include at least one of the first and secondimaging units 141 and 142 to photograph still images or moving picturesunder control of the controller 130. The imaging unit 140 may furtherinclude several imaging units. The first and second imaging units 141and 142 may be included in a body of the multi display device 100 or maybe connected to the multi display device 100 by using an additionalconnector. At least one of the first and second imaging units 141 and142 may include an auxiliary light source (for example, a flash (notillustrated)) that provides an amount of light necessary forphotographing.

The imaging unit 140 includes a lens and an image sensor. Types oflenses usable in the imaging unit 140 may include a general-purposelens, a wide angle lens, a zoom lens, etc. The first and second imagingunits 141 and 142 are generally imaging units including the same lens ormay are imaging units including different lenses.

The image sensor may be a complementary metal oxide semiconductor (CMOS)sensor or a charge-coupled device (CCD) sensor. In general, the firstand second imaging units 141 and 142 may be formed of one type of imagesensor but may formed of a combination of different types of imagesensors. For example, the first and second imaging units 141 and 142 mayuse CMOS sensors or CCD sensors or the first imaging unit 141 may usethe CMOS sensor, and the second imaging unit 140 b may use the CCDsensor.

The imaging unit 140 transmits an image photographed through at leastone of the first and second imaging units 141 and 142 to the controller130. The controller 130 analyzes the image to detect a motion or a shapeof a user and perform the detected motion or a control operationcorresponding to the detected motion. For example, the motion of theuser refers to a motion of a hand of the user detected through the firstor second imaging unit 141 or 142. The shape of the user may refer to aface shape of the user detected through the first or second imaging unit141 or 142.

According to another exemplary embodiment, the multi display device 100may detect a motion (movement or gesture) of the user by using anothermeans such as an infrared sensor and execute or control an applicationin response to the motion.

The sensor unit 150 includes a touch sensor 151, a geomagnetic sensor152, an acceleration sensor 153, a hinge sensor 154, and a proximitysensor 155.

The touch sensor 151 senses a touch of the user on a display unit. Thetouch sensor 151 may be classified into an electrostatic type and apiezoelectric type according to methods of sensing the touch of theuser. The touch sensor 151 according to an exemplary embodiment may berealized according to two types of methods. The touch sensor 151 and adisplay panel may be formed as the display unit. A detailed descriptionthereof will be described later with reference to additional drawings.

The touch sensor 151 generates a signal through display units 190 a and190 b using a body such as a user figure or a detectable input means toinput a command displayed on a display screen. The touch sensor 151 usesa capacity change, a resistance changes, or a light amount change.

The geomagnetic sensor 152 detects a geomagnetism to detect an azimuth.Therefore, the geomagnetic sensor 152 recognizes a direction of themulti display device 100. The acceleration sensor 153 processes anoutput signal to measure a dynamic force, such as an acceleration andvibrations of an object, a shock applied to the object, or the like, andsenses a change of a moving speed or an intensity of a force. The hingesensor 154 detects an angle, a movement, or the like of a hinge. Theproximity sensor 155 detects whether the object approaches the multidisplay device 100 of the user.

Although not illustrated in FIG. 42, the sensor unit 150 of the multidisplay device 100 may further include at least one of a gravity sensor,a gyro sensor, an orientation sensor, an illuminance sensor, an altitudemeasurement sensor, a red/green/blue (RGB) sensor, a distancemeasurement sensor, and a hall sensor. The gravity sensor detects inwhich direction gravity works, and the gyro sensor applies rotations toan existing acceleration sensor to recognize a total of 6 axes. Theorientation sensor automatically senses horizontal and vertical framesof a content, such as an image, to automatically rotate and arrange thecontent. The illuminance sensor detects an amount of light around themulti display device 100, the altitude measurement sensor measurespressure of air, and the RGB sensor detects a color of the object. Thedistance measurement sensor measures a distance by using ultrasonicwaves or infrared rays, and the hall sensor uses changes of a voltageaccording to an intensity of a magnetic field.

Each sensor of the sensor unit 150 may detect a status, generate asignal corresponding to the detected state, and transmit the signal tothe controller 130. The sensors of the sensor unit 150 may be added ordeleted according to a performance of the multi display device 100.

The input/output unit 160 includes a button unit 161, a microphone 162,a speaker 163, and a vibration motor 164.

At least one button unit 161 may be formed as a push type or a touchtype on a front side, a side, or back side of the body of the multidisplay device 100 and may include at least one of a power/lockingbutton, a volume adjustment button, a menu button, a home button, a backbutton, and a search button.

The microphone 162 receives a voice or a sound to generate an electricalsignal under control of the controller 130.

The speaker 163 outputs sounds corresponding to various types of signals(for example, a wireless signal, a broadcast signal, a digital audiofile, a digital video file, photo photographing, etc.) of the cellularcommunication module 111, the WLAN module 112, the NFC module 113, themultimedia unit 120, or the imaging unit 140 to the outside of the multidisplay device 100.

The speaker 163 outputs a sound (for example, a button control soundcorresponding to a telephone call or a ring back tone) corresponding toa function performed by the multi display device 100. One speaker 163 ora plurality of speakers 163 may be formed appropriate position orpositions of the multi display device 100. For example, the speaker 163includes an internal speaker module that is arranged in a positionappropriate to approach ears of the user and an external speaker modulethat has a high output appropriate to be used when playing anaudio/video file or viewing a broadcast and is arranged in anappropriate position of the body of the multi display device 100.

The vibration motor 164 converts the electric signal into a mechanicalvibration under control of the controller 130. For example, if the multidisplay device 100 that is in a vibration mode receives a voice callfrom another device (not illustrated), the vibration motor 164 operates.One vibration motor 164 or a plurality of vibration motors 164 may beformed in the body of the multi display device 100. The vibration motor164 operates in response to a touch gesture sensed on the first andsecond display units 190 a and 190 b and continuous movements of a touchsensed on the first and second display units 190 a and 190 b

The storage unit 170 stores various types of multimedia data and contentdata processed by the controller 130, data received from an externalsource, etc.

In detail, under control of the controller 130, the storage unit 170stores input/output signals, information, or data corresponding tooperations of the cellular communication module 111, the WLAN module112, the NFC module 113, the connector 114, the GPS module 115, themultimedia unit 120, the imaging unit 140, the sensor unit 150, theinput/output unit 160, and the first and second display units 190 a and190 b.

The storage unit 170 stores a control program and applications tocontrol the multi display device 100 or the controller 130. Hereinafter,the term “storage unit” may include a ROM, a RAM, or a memory card (forexample, a secure digital (SD) card, a memory stick, or the like) thatis attached to and/or detached from the multi display device 100. Thestorage unit may also include a nonvolatile memory, a volatile memory, ahard disk drive (HDD), or a solid state drive (SSD).

The power supply unit 180 supplies power used in the multi displaydevice 100. The power supply unit 180 may be realized as a rechargeablebattery and may further include a voltage converter that converts powersupplied from an external source to supply the power to the rechargeablebattery.

The power supply unit 180 may supply the power to the multi displaydevice 100 in various types of modes such as a maximum performance mode,a general mode, a sleep mode, a standby mode, etc. under powermanagement control of the controller 130.

The first and second display units 190 a and 190 b are connected to eachother through a hinge unit (not illustrated). The first and seconddisplay units 190 a and 190 b displays multimedia contents, images,moving pictures, texts, etc. under control of the controller 130.

The first and second display units 190 a and 190 b may have independenthousings physically separated from each other. Display screens displayedon the first and second display units 190 a and 190 b may beindependently controlled. For example, a resolution of the first displayunit 190 a and a resolution of the second display unit 190 b may beseparately set. Also, expansions, rotations, movements, divisions, etc.of screens displayed on the first and second display units 190 a and 190b may be separately executed.

The first and second display units 190 a and 190 b may be displayed as asingle display screen by using a virtual integrated frame buffer.

The first and second display units 190 a and 190 b may be realized asvarious types of display units such as an LCD panel, a PDP, an OLED, aVFD, an FED, an ELD, etc.

The first and second display units 190 a and 190 b may be realized asgeneral display panels having no touch inputs or touch display panelsthat recognize user controls by using a proximity sensor or a touchsensor. If the first and second display units 190 a and 190 b arerealized as the touch display panels, the first and second display units190 a and 190 b may receive at least one touch gesture through the bodyof the user (for example, fingers including a thumb) or a sensible inputmeans (for example, a stylus pen).

Such a user interface may include a predetermined touch area, a softkey, and a soft menu. The first and second display units 190 a and 190 bmay transmit an electronic signal corresponding to at least one touchgesture input through the user interface to the controller 130 via anLCD controller (not shown). The first and second display units 190 a and190 b may sense continuous movements of touches and transmit anelectrical signal corresponding to continuous or discontinuous movementof the touches to the LCD controller.

For example, the first and second display units 190 a and 190 b may berealized according to a resistive method, a capacitive method, aninfrared method, or an acoustic wave method.

The first and second display units 190 a and 190 b convert a sensingsignal of a motion of the user sensed through the touch sensor into adigital signal (for example, X and Y coordinates) and transmit thedigital signal to the controller 130. The controller 130 performs acontrol operation corresponding to a motion of the user input throughthe first and second display units 190 a and 190 b by using the receiveddigital signal. For example, the controller 130 may respond to themotion of the user to select a soft key displayed on the first andsecond display units 190 a and 190 b or execute an applicationcorresponding to the soft key.

The above-described gesture is not limited to a direct contact betweenthe first and second display units 190 a and 19 b and the body of theuser or a touchable input means but may include a non-contact method.Sensitivity of the motion of the user detectable by the first and seconddisplay units 190 a and 190 b may be changed according to a performanceor a structure of the multi display device 100.

According to an exemplary embodiment of the present general inventiveconcept, a touch gesture may include all kinds of user gestures thatdirectly contact or approach a touch screen to allow the multi displaydevice 100 to sense the direct contact or sensing. For example, thetouch gesture is a gesture of the user that selects one position or aplurality of continuous positions on the touch screen by using fingers(thumbs and index fingers) of left and right hands of the user or anobject (for example, a stylus pen) sensible through the touch screen.The touch gesture will now be described in detail with reference toTable 1 below.

TABLE 1 Type Mark Single Tap  

  Finger Touch & Hold  

  Gesture Double Tap  

  Drag  

  Drag & Drop  

  Flick  

 

Table 1 shows gesture types using one finger.

Referring to Table 1, the gesture types using one finger include a tap,touch & hold, a double tap, a drag, drag & drop, and a flick. The taprefers to a gesture of the user that slightly presses and takes off thetouch screen, the touch & hold refers to a long-time touch of the user,and the double tap refers to a gesture of the user that quickly performstapping two times. The drag refers to a gesture to perform dragging inone direction, the drag & drop refers to a gesture to press an arbitraryobject on the touch screen to drag the object from one position ontoanother position, and the flick refers to a gesture to perform fastdragging.

TABLE 2 Type Mark Two Two Finger Tap  

  Finger Touch & Spread  

  Gesture Pinch Out  

  Pinch In  

  Two Finger Drag  

  Cross Two Finger  

  Touch & Rotate  

 

Table 2 shows gesture types using two fingers.

Referring to Table 2, gesture types using two fingers include a twofinger tap, a touch & spread, a pinch-out, a pinch-in, a two fingerdrag, a cross two finger, a touch & rotate, etc. The two finger tap is agesture to simultaneously perform tapping through two fingers, and thetouch & spread is a gesture to simultaneously press the touch screenthrough two fingers and linearly moving one finger without moving theother finger. The pinch-out is a gesture to press the touch screenthrough two fingers and then to perform dragging in differentdirections, and the pinch-in is a gesture to simultaneously press thetouch screen through two fingers and then to perform dragging in afacing direction. The two finger drag is a gesture to perform draggingin the same direction through two fingers, and the cross two finger is agesture to simultaneously perform dragging in facing directions and thento pass two fingers in contrary directions. The touch & rotate is atouch gesture to rotate one finger based on the other finger withoutmoving the other finger.

TABLE 3 Type Mark Multi Three Finger Touch  

  Finger Four Finger Touch  

  Gesture Five Finger Touch  

  Palm Palm  

 

Table 3 shows gesture types using two or more fingers and a palm.

Referring to Table 3, gesture types using two or more fingers include athree finger touch, a four finger touch, a five finger touch, etc. Also,as shown in Tables 1 and 2 described above, gestures, such as a tap, adrag, a rotate, etc., may be performed by using two or more fingers.

If the above-described various touch gestures are recognized, thecontroller 130 performs operations corresponding to the touch gestures.For example, the controller 130 may execute an application, a widget, aweb browser, or the like stored in the storage unit 170 to display anexecution screen on at least one of the first and second display units190 a and 190 b.

Bodies of the multi display device 100 are connected to each otherthrough a hinge unit in the above-described exemplary embodiments butmay be connected to each other through a connector formed of a flexiblematerial instead of the hinge unit.

FIG. 43 is a block diagram illustrating a multi display device 100according to an exemplary embodiment of the present general inventiveconcept.

Referring to FIG. 43, the multi display device 100 includes acommunicator 110, a multimedia unit 120, a controller 130, an imagingunit 140, a sensor unit 150, an input/output unit 160, a storage unit170, a power supply unit 180, and a multi display unit (or dual displayunit) 190. Descriptions of the same elements of FIG. 43 as those of FIG.42 will be omitted, and only a display process will be described

A central processing unit (CPU) 131 reads data stored in the storageunit 170 into an RAM 135 to transmit data necessary for graphicprocessing among data stored in the RAM 135 to a graphic processing unit(GPU) 133. The CPU 131 receives data graphically processed by the GPU133 and transmits the data to an LCD controller (not illustrated)connected to a system bus 139 to display an image on the display unit190.

The CPU 131 temporarily stores image data processed by the GPU 133 in avirtual frame buffer allocated to a predetermined area of the RAM 135.The CPU 131 allocates an area of the virtual frame buffer to support amaximum resolution (for example, 1024×600) of the display unit 190.

If the display unit 190 is two display units, the CPU 131 allocates anarea of the virtual frame buffer in a size of 1024×1200

The CPU 131 inputs the data temporarily stored in the virtual framebuffer into the GPU 133 to perform digital signal processing withrespect to the data.

The GPU 133 performs graphic processing with respect to the data inputunder control of the CPU 131. In detail, the GPU 133 generates a screenincluding various types of objects, such as an icon, an image, a text,etc., by using an operator unit (not illustrated) and a renderer (notillustrated). The operator unit calculates attribute values such ascoordinate values at which the objects are respectively displayedaccording to a layout of the screen, shapes, sizes, and colors of theobjects, etc. The renderer generates a screen having various types oflayouts including the objects based on the calculated attribute values.The screen generated by the renderer may be transmitted to the first andsecond display units 190 a and 190 b through the system bus 139 to bedisplayed in a display area or to be stored in the storage unit 170

The CPU 131 displays the data graphically processed by the GPU 133through at least one of the first and second display units 190 a and 190b, controls to store the data in the storage unit 170, or inputs thedata into a display controller (not shown)

The GPU 133 may include a decoder, a renderer, a scaler, etc. Therefore,the GPU 133 decodes a stored content, renders the decoded content datato form a frame, and scales a size of the frame to a display size undercontrol of the display controller. If the screen is displayed on one ofthe first and second display units 190 a and 190 b, the GPU 133 scalesthe content to a size of the screen. If the screen is displayed on bothof the first and second display units 190 a and 190 b, the GPU 133scales the content to a full display size. The GPU 133 provides theprocessed frame to the display unit to display the processed frame.

The multi display device 100 includes a plurality of display units andthus provides various types of screens by using the plurality of displayunits. A basic detailed structure and operations of a multi displaydevice according to various exemplary embodiment of the present generalinventive concept will now be described.

FIG. 44 is a block diagram illustrating a multi display device tocontrol operations of display units by using a plurality of framebuffers according to an exemplary embodiment of the present generalinventive concept.

Referring to FIG. 44, the multi display device includes first and seconddisplay units 190 a and 190 b and a display controller 175. The displaycontroller 175 may be an element provided separately from the controller130 of FIG. 32 or may be an element included in the controller 130.

Referring to FIG. 44, the display controller 175 includes first andsecond display drivers 175 a-1 and 175 a-2 and first and second displaydrivers 175 a-2 and 175 b-2.

The first frame butter 175 a-1 buffers an image frame which is to bedisplayed on the first display unit 190 a, and the second frame buffer175 b-1 buffers an image frame which is to be displayed on the seconddisplay unit 190 b.

An image frame that is processed as a digital signal by the GPU 133 isstored as a bitmap format in the first and second frame buffers 175 a-1and 175 b-1. In this case, buffering areas of the first and second framebuffers 175 a-1 and 175 b-1 are allocated according to a maximum pixelsize supportable by the first and second display units 190 a and 190 b.The first display driver 175 a-2 analyzes the image frame stored in thefirst frame buffer 175 a-1 to convert the image frame into a first imagesource signal. The first display driver 175 a-2 provides the first imagesource signal to the first display unit 190 a to drive the first displayunit 190 a so that the first display unit 190 a displays the imageframe.

Similarly, the second display driver 175 b-2 analyzes the image framestored in the second frame buffer 175 b-1 to convert the image frameinto a second image source signal and provides the second image sourcesignal to the second display unit 190 b to display the image frame.

The first and second frame buffers 175 a-1 and 175 b-1 respectivelycorresponding to the first and second display units 190 a and 190 b areseparately provided in FIG. 44 but may be used as one integrated framebuffer according to another exemplary embodiment of FIG. 45.

FIG. 45 is a block diagram illustrating a multi display device tocontrol operations of display units by using an integrated frame bufferaccording to an exemplary embodiment of the present general inventiveconcept.

If a frame buffer is realized as an integrated frame buffer 175-1, asize thereof greater than maximum resolutions of first and seconddisplay units 190 a and 190 b may be allocated to the integrated framebuffer 175-1

For example, if the first and second display units 190 a and 190 bdisplay resolutions of 1024*800, the integrated frame buffer 175-1allocates a storage area having a frame buffer size for displaying aresolution of 1024*1600. A first area of the integrated frame buffer175-1 includes a first image frame displayed on the first display unit190 a, and a second area of the integrated frame buffer 175-1 stores asecond image frame displayed on the second display unit 190 b.

A display driver 175-2 provides the first and second image frames to thefirst and/or second display units 190 a and/or 190 b by using addressesof the first and second image frames stored in the integrated framebuffer 175-1.

FIG. 46 is a detailed view illustrating the first display unit 190 a ofFIG. 44.

FIG. 46 illustrates a display unit having the first and second displayunits 190 a and 190 b according to an exemplary embodiment of thepresent general inventive concept. For convenience of description, onlythe first display unit 190 a is illustrated in FIG. 46, the seconddisplay unit 190 b may also be realized as the same type as the firstdisplay unit 190 a.

Referring to FIG. 46, the first display unit 190 a includes a timingcontroller 231, a gate driver 232, a data driver 233, a voltage driver234, and a display panel 235.

The timing controller 231 receives a clock signal DCLK, a horizontalsync signal Hsync, a vertical sync signal Vsync, etc., appropriate for aresolution of a touch screen from an external source to generate andoutput a gate signal (a scan control signal) and a data control signal(a data signal) to the gate driver 232 and the data driver 233,respectively, and re-arranges received R, G, and B data to provide there-arranged R, G, and B data to the data driver 233.

Timing controller 231 generates a gate shift clock (GSC), a gate outputenable (GOE), a gate start pulse (GSP), etc., in relation to the gatecontrol signal. Here, the GSC is a signal that determines a time when athin film transistor (TFT) connected to light-emitting devices such asR, G, and B OLEDs is turned and/or off. The GOE is a signal thatcontrols an output of the gate driver 232, and the GSP is a signal thatindicates a first driving line of one vertical sync signal.

The timing controller 231 generates a source sampling clock (SSC), asource output enable (SOE), a source start pulse (SSP), etc., inrelation to the data control signal. Here, the SSC is used as a samplingclock for latching data in the data driver 233 and determines a drivingfrequency of a data drive integrated circuit (IC). The SOE is used totransmit data latched through the SSC to the display panel 235. The SSPis a signal that indicates a start of latching or sampling of data forone horizontal sync period.

The gate driver 232 is an element that generates a scan signal and isconnected to the display panel 235 through scan lines S1, S2, S3, . . ., and Sn. The gate driver 232 applies a gate on/off voltage (Vgh/Vgl)provided from the voltage driver 234 to the display panel 235 accordingto the gate control signal generated by the timing controller 231. Thegate on voltage Vgh is sequentially provided to the display panel 235from a first gate line GL1 to an Nth gate line GLn to realize a unitframe image.

The data driver 233 is an element that generates a data signal and isconnected to the display panel 235 through data lines D1, D2, D3, . . ., and Dm. The data driver 233 inputs R, G, and B data of an image frame,which is completely scaled according to the control signal generated bythe timing controller 231, into the display panel 235. The data driver233 converts R, G, and B image data serially provided from the timingcontroller 231 into parallel R, G, and B image data and converts digitaldata into an analog voltage to provide image data corresponding to onehorizontal line. This process is sequentially performed according tohorizontal lines.

The voltage driver 234 generates driving voltages and respectivelytransmits the driving voltages to the gate driver 232, the data driver233, the display panel 235, etc. In other words, the voltage driver 234receives commercial power, i.e., an alternating current (AC) voltage of110V or 220V, from an external source to generate and provide a powersupply voltage VDD necessary for the display panel 235 or provide aground voltage VSS. Also, the voltage driver 234 generates a gate onvoltage Vgh and provides the gate on voltage Vgh to the gate driver 232.For this purpose, the voltage driver 234 may include a plurality ofvoltage driving modules (not illustrated) that separately operate. Here,the plurality of voltage driving modules operate to provide differentdriving voltages under control of the controller 130. The controller 130controls the voltage driver 230 to provide the different drivingvoltages through the plurality of voltage driving modules according topreset information. For example, the plurality of voltage drivingmodules respectively provide different first voltages and secondvoltages set to defaults according to preset information under controlof the controller 130.

According to an exemplary embodiment, the voltage driver 234 may includea plurality of voltage driving modules respectively corresponding to aplurality of areas of the display panel 235. In this case, thecontroller 130 controls the plurality of voltage driving modules toprovide the different first voltages, i.e., a voltage ELVDD, accordingto screen information (or input image information) of the plurality ofareas. In other words, the controller 130 controls a size of the voltageELVDD by using an image signal input into the data driver 233. Here, thescreen information may be at least one of luminance and gradationinformation of an input image.

The display panel 235 includes a plurality of gate lines GL1 through GLnand a plurality of data lines DL1 through DLm that intersect with oneother to define a pixel area 236. R, G, and B light-emitting devicessuch as OLEDs may be formed in the pixel area 236. A switching device,i.e., a TFT, is formed in an area of the pixel area 235, furtherprecisely, at a corner. When the TFT is turned on, a gradation voltageis provided from the data driver 233 to the R, G, and B light-emittingdevices. Here, the R, G, and B light-emitting devices provide lightcorresponding to an amount of a provided current based on the gradationvoltage. In other words, if a large amount of current is provided, theR, G, and B light-emitting devices provides light of an amountcorresponding to the large amount of current.

FIG. 47 is a view illustrating a circuit configuration of a pixel area236 having R, G, and B pixels of the display panel 235 of FIG. 46.

Referring to FIG. 47, the display panel 235 includes a plurality ofpixel areas 236 each having three R, G, and B pixels. The R, G, and Bpixel areas include switching elements M11, M21, and M31 that operateaccording to a scan signal S1 and a gate on voltage Vgh, switchingelements M12, M22, and M32 that output currents based on pixel valuesincluding changed high gradation value provided to data lines DL1through DLm, and switching elements M13, M23, and M33 that adjustamounts of currents provided from the switching elements M12, M22, andM23 to the R, G, and B light-emitting devices. The switching elementsM13, M23, and M33 respectively connected to the OLEDs to supply currentsto the OLEDs. Here, the OLEDs refer to displays that self-emit light byusing a principle of electroluminescence if a current flows influorescent or phosphorescence organic thin films. Anodes of the OLEDsare connected to pixel circuits, and cathodes of the OLEDs are connectedto ELVSS. The OLED described above generate light having predeterminedluminance in response to currents supplied from the pixel circuits.Here, gate electrodes of the switching elements M11, M21, and M31 areconnected to the scan line S1, and source electrodes or drain electrodesof the switching elements M11, M21, and M31 are connected to a data lineD1. As described above, the display panel 235 may be realized as anactive matrix OLED (AM-OLED) panel. However, the above-describedexemplary embodiment is only an exemplary embodiment and thus thepresent general inventive concept does not exclude a passive matrixOLEDs (PM-OLED) in which one line simultaneously emits light.

OLEDs are described in the exemplary embodiment of FIG. 47, but adisplay unit may be realized as various types of display technologiessuch as an LCD panel, a PDP, a VFD, an FED, an LED, etc.

FIG. 48 is a view illustrating a system hierarchical structure of amulti display device according to an exemplary embodiment of the presentgeneral inventive concept. The multi display device includes hardware410 and various types of software (programs) such as an operating system(OS) 420, a framework 430, a call application 441, a multimediaapplication 442, a camera application 443, a browser 444, a gesturerecognition application 445, etc.

The hardware 410 may include various elements as illustrated in FIG. 42.

The OS 420 controls an overall operation of the hardware 410 and managesthe hardware 410. In other words, the OS 420 is a hierarchy that takescharges of basic functions such as a hardware management, a memory,security, etc. The OS 420 drives modules, such as a display driver, acommunication driver, a camera driver, an audio driver, a power manager,etc., to control an operation of a corresponding device, such as thedisplay device. Here, the display driver drives a multi display unit,the communication driver transmits and receives data, the camera driverdrives an imaging unit, and the audio driver drives an audio unit

The framework 430 is a hierarchy higher than the OS 420. The framework430 connects an application hierarchy 440 to the OS 420. In other words,the framework 430 includes a location manager, a notification manager,and a frame buffer to display an image on a display unit.

The application hierarchy 440 is a hierarchy higher than the framework430 and realizes various functions of the multi display device. Forexample, the application hierarchy 440 may include various types ofapplication programs, such as an application for the call 441, anapplication for the multimedia 442, an application for the camera 443,an application for the browser 444, an application for the gesturerecognition 445, etc.

FIG. 49 is a view illustrating a method of sensing a proximity touch.

A user may input a control command into the multi display device 100according to a proximity touch method using a proximity sensor. Theproximity touch refers to a touch gesture that is recognized as a motionwithin a predetermined effective recognition range of a space withoutdirectly touching a touch screen.

Referring to FIG. 49, a display unit includes a display panel 290, aninfrared source unit 291 to recognize the proximity touch, and aninfrared sensing unit 292. The infrared source unit 291 irradiatesinfrared rays in a surface direction of the display unit. In detail, theinfrared source unit 29 a is arranged in a lower portion of the displayunit that displays a picture or an image and irradiates the infraredrays in the surface direction f the display unit. A predetermined areato recognize a proximity of a user object 50 exists on a surface of thedisplay unit. This area is an effective recognition area 5 to recognizea touch proximity.

The user object 50 refers to a means to input a command into the multidisplay device 100, for example, may be a part of a body such as a hand,an extension of a body part, or the like.

If the user object 50 approaches an inside of the effective recognitionarea 5, the infrared sensing unit 292 senses an infrared ray reflectedby the proximity of the user object 50 to generate an infrared scanimage. In detail, the infrared sensing unit 292 generates the infraredscan image corresponding to the infrared ray reflected by the proximityof the user object 50 by using a plurality of infrared sensing elementsarranged in an array form. The multi display device 100 senses aproximity touch input by using the generated infrared scan image.

FIG. 50 is a view illustrating a method of sensing a proximity touchaccording to another method. A user inputs a control command into amulti display device according to a proximity touch method using apredetermined pen.

Referring to FIG. 50, a display unit includes a display panel 290 a, aproximity sensor source unit 291 a, and a sensing unit 292 a asdescribed with reference to FIG. 49. To allow proximate touchrecognition, the pen 49 may include a coil. The display unit includes anelectrostatic sensor 293. The electrostatic sensor 293 may include aplurality of coils.

If the pen 49 including the coil becomes closes within a predetermineddistance 5 a, a current is induced into the coils of the electrostaticsensor 293 due to an electrostatic induction phenomenon. The current ismost greatly induced into the coil close to the pen 49 and is smallinduced into coils distance from the pen 49. Therefore, a controllerrecognizes a point into which the current is most greatly induced as aposition of the pen 49.

The display unit illustrated in FIG. 50 includes the infrared sensingunit 292 a. Therefore, if the pen 49 becomes close to the display unitwithin a predetermined distance, both the infrared sensing unit 292 aand the electrostatic sensor 293 recognize the proximity of the pen 49.Therefore, a priority is given to a proximity recognition of theelectrostatic sensor 293 to solve a problem of a dual recognition.

FIG. 51 is a flowchart illustrating a photographing method of a multidisplay device according to an exemplary embodiment of the presentgeneral inventive concept.

Referring to FIG. 51, in operation S5110, the multi display deviceperforms photographing by using a first imaging unit provided in a firstbody or a second imaging unit provided in a second body. Imagesphotographed by the first and second imaging units may be displayed onfirst and/or second display units. In operation S5120, the multi displaydevice combines a plurality of images that have been photographed togenerate a panorama image content. When the first or second body pivotsbased on a hinge unit, the photographing may be performed by the firstor second imaging unit. Alternatively, a first live view generated bythe first imaging unit may be displayed through the first display unit,and a second live view generated by the second imaging unit may bedisplayed through the second display unit. If a size of an overlappingarea between the first and second live views meets a preset condition,the first and second imaging units may be respectively controlled toperform photographing. A detailed photographing method and a detailedgenerating method for generating the panorama image content are asdescribed above and thus will be omitted herein.

FIG. 52 is a flowchart illustrating a photographing method of a multidisplay device according to an exemplary embodiment of the presentgeneral inventive concept.

Referring to FIG. 52, in operation S5210, the multi display deviceperforms photographing by using first and second imaging units. Inoperation S5220, the multi display device combines a first imagephotographed by the first imaging unit and a second image photographedby the second imaging unit to generate one image content. The one imagecontent may be a panorama image content or a 3D image content. In orderto generate one 3D image content, the first image is processed as a lefteye image, and the second image is processed as a right eye image tocombine the left and right eye images.

FIG. 53 is a flowchart illustrating a photographing method of a multidisplay device according to an exemplary embodiment of the presentgeneral inventive concept.

Referring to FIG. 53, in operation S5310, the multi display devicedisplays a setting screen to select functions of first and secondimaging units through at least one of first and second display units.The functions of the first and second imaging units may be variousfunctions such as general photographing, moving picture photographing,shutter first photographing, iris first photographing, special effectphotographing, continuous photographing, etc. In operation S5320, themulti display device respectively set selected functions with respect tothe first and second imaging units. If the number of photographing unitsis 3, different functions may be set with respect to the three imagingunits.

According to various exemplary embodiments of the present generalinventive concept as described above, a multi display device including aplurality of display units performs photographing by using a pluralityof imaging units to generate a 3D image content or a panorama imagecontent. Also, the multi display device may perform various functions ofphotographing by using the plurality of imaging units. Therefore,further various functions of imaging units may be used.

Therefore, the multi display device generates various types of images byusing images photographed by a plurality of cameras.

A method of controlling an operation of the multi display device and aphotographing method of the multi display device according to theabove-described various exemplary embodiments may be realized as aprogram to be provided to the multi display device.

For example, there may be provided a non-transitory computer-readablemedium that stores a program to execute a method described above orhereinafter. The method may be referred to include performingphotographing by using a first imaging unit provided in a first body ofa multi display device or a second imaging unit provided in a secondbody, and combining a plurality of images photographed by the first andsecond imaging units to generate one image content.

The non-transitory computer-readable medium refers to a medium whichdoes not store data for a short time such as a register, a cache memory,a memory, or the like but semi-permanently stores data and is readableby a device. In detail, the above-described applications or programs maybe stored and provided on a non-transitory computer readable medium suchas a CD, a DVD, a hard disk, a blue-ray disk, a universal serial bus(USB), a memory card, a ROM, or the like.

The foregoing exemplary embodiments and advantages are merely exemplaryand are not to be construed as limiting. The present teaching can bereadily applied to other types of apparatuses. Although a fewembodiments of the present general inventive concept have been shown anddescribed, it will be appreciated by those skilled in the art thatchanges may be made in these embodiments without departing from theprinciples and spirit of the general inventive concept, the scope ofwhich is defined in the appended claims and their equivalents.

What is claimed is:
 1. A multi display device comprising: a first bodyhaving a first display unit; a second body having a second display unit;a hinge unit disposed to couple to the first and second bodies; a firstimaging unit disposed in the first body and configured to performphotographing; a second imaging unit disposed in the second body andconfigured to perform photographing; and a controller configured to, inresponse to one of the first and second imaging units performingphotographing of a plurality of images while one of the first and secondbodies having the one of the first and second imaging units pivots basedon the hinge unit, combine the plurality of photographed images togenerate a panorama image content.
 2. The multi display device of claim1, wherein, while the first body pivots in a first direction based onthe hinge unit, the controller controls the second display unit todisplay a live view generated by the first imaging unit and performsphotographing of the plurality of images by using the first imaging unitto capture the plurality of images within a first photographing range,and combines the plurality of captured images within the firstphotographing range to generate the panorama image content.
 3. The multidisplay device of claim 1, wherein: while the first body pivots in afirst direction based on the hinge unit, the controller controls thesecond display unit to display a live view generated by the firstimaging unit and performs photographing of a first plurality of imagesby using the first imaging unit to capture the first plurality of imageswithin a first photographing range; while the second body pivots in asecond direction opposite to the first direction based on the hingeunit, the controller controls the first display unit to display a liveview generated by the second imaging unit and performs photographing ofa second plurality of images by using the second imaging unit to capturethe second plurality of images within a second photographing range; andthe controller combines the first plurality of captured images capturedwithin the first photographing range and the second plurality ofcaptured images captured with in the second photographing range to oneanother to generate the panorama image content.
 4. The multi displaydevice of claim 2, wherein, while a particular portion of a subject isrecognized in the live view, the controller performs automaticphotographing of the plurality of images.
 5. The multi display device ofclaim 2, wherein, while an interval angle between the first and secondbodies meets a set condition, the controller performs automaticphotographing of the plurality of images.
 6. The multi display device ofclaim 2, wherein, while the pivoting starts, the controller performsautomatic photographing of the plurality of images every set timeperiod.
 7. The multi display device of claim 1, wherein the controllercontrols at least one of the first and second display units to display aphotographing range setting screen if a panorama photographing modestarts and automatically adjusts one or more photographing angles of thefirst and second imaging units according to a set photographing range ifthe photographing range is set on the photographing range settingscreen.
 8. The multi display device of claim 1, wherein the controllercontrols at least one of the first and second display units to display aphotographing range setting screen if a panorama photographing modestarts and displays a guide image on the first and second display units,wherein the guide image induces one or more photographing angles of thefirst and second imaging units to be adjusted according to a setphotographing range if the photographing range is set on thephotographing range setting screen.
 9. The multi display device of claim1, wherein the controller controls at least one of the first and seconddisplay units to display a setting screen to respectively set one ormore functions of the first and second display units and separatelycontrols display operations of the first and second display unitsaccording to the one or more functions selected on the setting screen.10. The multi display device of claim 9, wherein if a panorama displayfunction is set on the first display unit, and a general displayfunction is set on the second display unit, the controller controls todisplay the panorama image content on the first display unit andcontrols to display at least one of image contents respectivelyphotographed by the first and second imaging units on the second displayunit.
 11. A photographing method of a multi display device including afirst body having a first display unit, a second body having a seconddisplay unit, a hinge unit disposed to couple to the first and secondbodies, a first imaging unit disposed in the first body and configuredto perform photographing, and a second imaging unit disposed in thesecond body and configured to perform photographing, the photographingmethod comprising: performing photographing of a plurality of images byusing one of the first and second imaging units in response to one ofthe first and second bodies having the one of the first and secondimaging units pivots based on the hinge unit; and combining theplurality of photographed images to generate a panorama image content.12. The photographing method of claim 11, wherein: while the first bodypivots in a first direction based on the hinge unit, a live viewgenerated by the first imaging unit is displayed on the second displayunit, and the photographing of the plurality of images is performed byusing the first imaging unit to capture the plurality of images within afirst photographing range; and the plurality of captured images capturedin the first photographing range are combined to one another to generatethe panorama image content.
 13. The photographing method of claim 11,wherein: while the first body pivots in a first direction based on thehinge unit, a live view generated by the first imaging unit is displayedon the second display unit, and the photographing of a first pluralityof images is performed by using the first imaging unit to capture thefirst plurality of images within a photographing range; while a secondbody pivots in a second direction different from the first directionbased on the hinge unit, a live view generated by the second imagingunit is displayed on the first display unit, and the photographing of asecond plurality of images is performed by the second imaging unit tocapture the second plurality of images within a second photographingrange; and the first plurality of captured images captured within thefirst photographing range and the second plurality of captured imagescaptured within the second photographing range are combined to oneanother to generate the panorama image content.
 14. The photographingmethod of claim 12, wherein, while a particular portion of a subject isrecognized in the live view, automatic photographing of the plurality ofimages is performed.
 15. The photographing method of claim 12, wherein,while an interval angle between the first and second bodies meets a setcondition, automatic photographing of the plurality of images isperformed.
 16. The photographing method of claim 12, wherein, while thepivoting starts, automatic photographing of the plurality of images isperformed every set time period.
 17. The photographing method of claim11, wherein if a panorama photographing mode starts, a photographingrange setting screen is displayed through at least one of the first andsecond display units, and if a photographing range is set on thephotographing range setting screen, photographing angles of the firstand second imaging units are automatically adjusted according to the setphotographing range.
 18. The photographing method of claim 11, whereinif a panorama photographing mode starts, a photographing range settingscreen is displayed through at least one of the first and second imagingunits, and a guide image is displayed on the first and second displayunits, wherein the guide image induces photographing angles of the firstand second imaging units to be adjusted according to a set photographingrange if the photographing range is set on the photographing rangesetting screen.
 19. The photographing method of claim 11, furthercomprising: displaying a setting screen to respectively set one or morefunctions of the first and second display units through at least one ofthe first and second display units; and displaying the one or morefunctions selected on the setting screen on the first and second displayunits.
 20. The photographing method of claim 19, wherein if a panoramadisplay function is set on the first display unit, and a general displayfunction is set on the second display unit, the panorama image contentis displayed on the first display unit, and at least one of imagecontents photographed by the first and second imaging units is displayedon the second display unit.
 21. A multi display device comprising: afirst body having a first display unit and a first imaging unit, thefirst imaging unit configured to perform photographing; a second bodyhaving a second display unit and a second imaging unit, the secondimaging unit configured to perform photographing; a hinge unit disposedto couple to the first and second bodies; and a controller configuredto: control the first imaging unit to perform photographing of aplurality of images while the first body pivots based on the hinge unit,control the second imaging unit to display a live view generated by thefirst imaging unit, and combine the plurality of photographed images togenerate an image content.